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ABSTRACT 

This document aontains the proceedings of a tuo-day 
symposium conducted to analyze four different perspectives 
(psychcloqica 1 p economic ^ anthropological^ and sccioloqical) on 
evaluatinq experiential education programs* The perspectives are 
ie|Fresent€d in papers ty Samuel H. Osipow, Psychology^ Ohio State 
Onlversity; Nicholas M. Kiefer^ Economics^ University of Chicagc; 
Sheila S. Walkerr A nthropology^ Onlversity of California; and Prank 
J* Weed and Charles E, Bafflsey^ Sociology^ University of Texas- The 
keynote address^ by Richard Graham of Youthwork^ Inc., is followed by 
a section for each perspective. Each section fceglns with the major 
presentation and includes a sumniary of the ccmmeritary by participants 
en the advantages and lifflitations of the particular perspective in 
evaluatinq experiential education prograiis* Follciiing the commentary 
is a summary of the perspective by an individual who represents that 
perspective and is an experientlai education practitioner. The last 
section cffers reflections on the symposium by Thomas R. Owens, 
Northwest Regional Educational Laboratory; and Dan Conrad, University 
of Minnesota. The symposium agenda, a list of participant's, and 
bicqtaphical sketches of the authors are appended. (LMS) 
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FOREWORD 



Experiential Education has been a major part of learning for internships, cooperative and work 
study programs, and on^the^job components of vocational education. Since the early 1970s there 
has been a movement in education to expand the educational opportunities of all students to in- 
clude real world learning experiences as part of their educational programs. One of the most chal= 
lenging problemb for the continued eKpanslon of experiential education is developing effective 
methods and criteria for evaluating experiential education. 

Under sponsorship of the National Institute of Education, the National Center for Research in 
Vocational Education conducted a symposium on Alternative Perspectives on Investigating the Con- 
sequences of Experiential Education. This symposium provided the opportunity to consider some 
fundamentally different options and approaches to underitanding experiential education and to 
explore evaluation approaches from diverse disciplines and perspectives. The lymposium was the 
setting that brought together individuals who represented evaluators, researchers, state department 
planners, and experiential education program coordinators to critique and analyze the four per- 
spectives on investigating the consequencei of experiential education. The report should be con- 
sidered as a resource for individuals interested In learning more about experiential education and 
evaluation. This document is a collection of substantive papers.with participants' commentary re- 
garding the advantages and limitations of the perspective as it relates to evaluating experiential edu- 
cation programs. Finally, the report contains summaries of the perspectives by Individuals who 
represent the particular perspective and are experiential education practitioners. 

The individuals who represented their discip-^ine and provided a perspective on investigating the 
consequences of experiential education are recogni7ed for their persistent and scholarly approach to 
the problem. They are Samuel H, Osipow, Psychology, The Ohio State University; Nicholas M. 
Kiefer, Economics, University of Chicago; Sheila S, Walker, Anthropology, University of California; 
and Frank J. Weed and Charles E. Ramsey, Sociology, University of Texas. 

Special appreciation is extended to Ronald B. Bucknam, Project Officer for the National 
Institute of Education, for his assistance throughoui^ the development of the symposium and his 
participation and contributions made at the symposium. 

Recognition is due Michael R. Crowe for his overall direction of the project and for the prepara- 
tion of their report; Carol A. Beckman for the coordination and arrangement of the symposium 
activities and assitance in preparing this report; and Jerry P, Walker for his guidance and support of 
the project. 



Robert E. Taylor ^ 
Executive Director . 
The National Center for nesearch 
in Vocational Education 
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INVITATION 

TO THE READER 



OVERVIEW 

We were motivated tu design and conduct the symposium because of our recent experiences 
in conducting a national evalumion of an internship type experiontiai education prociram. While 
conductint) the evaluation, we hbd the opportunity to talk with evaluators of other experiential 
education programs, and we learnb J slowly that we were not the first, nor would we probably be 
the last, to face a perplexing set of problems in evaluating innovative experiential education pro^ 
grams. We were, therefore, prompted to retreat from our educational evaluators' perspective of edu = 
cationni phenomona and invite individuals from other disciplines to [Drovide us with alternative 
perspectives on Investigating experiential education programs. We v^/anted them not only to focus on 
that small set of consequences which happen to be the intention of educators, but also to focus on 
any possible consequences: positive, negative, unanticipated, learner=focused, society-focused and 
others. 

Our hope was that we would be able to capture many of the issues about program effective^ 
ness that are discussed among evaluators and practitinners who advocate the expansion of expyri^ 
ontial education. Many of the issues raised are widely focused, in that there have been few 
opportunities to creatively investigate evaluative problems surrounding experiential education 
phenomena. We felt a need to disassociate ourselves from the language of evaluation and, therefore, 
stated the problem in terms of investigating the consequences of experiential education. This, we 
hoped, would expand our horizons and encourage alternative perspectives that would not be con^ 
strained by our language and historical parameters for evaluating experiential education programs. 

We believe we a^h\-^Bd this purpose. The symposium did provide alternative directions for 
investigating the consequences of experiential education. The following Ideas seem particularly 
useful for future investigations, 

• Extend the notion that luck or chance create critical incidents which cause major changes 
in a person's life, i.e., to consider an experiential education program as a critical incident 
in a student's life. 

Rather than leaving major life changes to chance, increase the number of experiences so 
as to increase the probability of students encountering a critical incident. The success of the 
program (experience) would be measured in terms of pran:Hjnced change in the direction 
that a student's life took rather than specific changes in thii student's behavior. 

® Develop experiential programs within the context ofcaree' development theories. 

The theory or framework would serve as the vehicle by which to specify how the program 
should contribute to the development of a student's career Measurement would involve 
using individu ils as their own base line control and then acgregating in terms of the particu 
lar objective specified by the theory. 

# Choose a variable that is related to program nutconws to chtennine the effectiveness of 
experiential education programs.: 

A labor market variable such as earnings was suggested as rc\isonable. Earnings are less am 
biquous than test scores as measures of program effectiveness and do not require elaborate 
constructs to define their meaning. Measurement would involve repeated observations of 
earnings of participants and non participants of experiential education programs. 
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INVITATION 
TO THE READER 



© Use Girect observation to describ& the structure of relationships among individuals and 
between individuals and thelt environment. 

Since standaidized tests do not always explain student behavior, the um of observation 
would provide additional evidence to explain what really happens in a program. Measure- 
ment would, therefore, rely on the accuracy of the observations. 

« Extend the scope of analysis to include social structure. 

This would add the dimension of understanding the student^s motives, beliefs, and actions 
as a product of social relationships. The unit of analysis would be the school rather than 
the individual. Rather than using a single measure or repeated observations, the use of 
several methods to test the same points is encouraged to find evidence of program effective- 
ness. 

The results of the symposium provided provocative ideas for future investigations, but did not 
lead to a single approach or new methodologies for evaluating experiential education programs. 
Many of the ideas have been tried, in part, by different evaluators of innovative programs. What 
the symposium accomplished was to confirm many of the techniques evaluators have already used 
but often expressed doubts about because they were not based in experimental research. The next 
step is to develop fully, understand, and implement the ideas from this symposium in future evalu- 
ations. We invite the reader to join symposium participants who listened to provocative ideas and 
reacted with probing and thoughtful comments. 

Michael R. Crowe 
Project Director 

The National Center for Research 
in Vocational Education 
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SYMPOSIUM 

PROCiSS 



Purpose of Symposium 

The USD of traditional methods to evaluate eKperiential education programs has not always 
provided the data sought by program developers. Part of the dilemma may be the nature of such 
programs. They differ from traditional learning experiences in both process and outcomes, The 
experiential process is more individualized and defined by environment. Knov\iMng throuqh doing 
becomes the focus of attention. The outcomes are often affective in naiure and difficult lo measure. 
Other factors contributing to the dilemma are: 

• the difficulty in finding evidence of success for highly diversified programs; 

• heart=felt testimony, but little quantitative evidence; 

« narrowness of what is considered credible evidence for success; 

• use of behavioral objectives for programs that are individualized and experience oriented; 
and 

• use of paper and pencil tests for measuring reality-based know-how. 

Experiential education programs will almost certainly continue to expand. However, at this 
point there is little consensus on evaluation criteria by which to determine whether the programs 
should be viewed as beneficiaL Therefore, we believe that the atmosphere and timing call for con- 
sideration of alternative approches to understanding experiential education phenomena. The sym- 
posium provided an opportunity to explore evaluation approaches from the perspectives of several 
disciplines. 

The purposes identified for this symposium were to provide a forum for: 

• reviewing and critiquing alternative perspectives and investigative strategies. 

• reacting to new directions in understanding experiential education phenomena and evalua- 
tion, 

■ • exchanging ideas on evaluation practices, 

Selection of Authors 

fo re-examine the consequences of experiential education and to seek alternative investigation 
strategies, individuals from four disciplines were commissioned to prepare papers reflecting their 
viewpoints, A two-day field experience provided the authors an orientation to experiential educa^ 
tion. Arrangements were made for the writers to visit an alternative school and an Occupational 
Work Experience Program where they interviewed the coordinators, students, and employers. In 
addition, a panel of coordinators and students from nine experiential education programs was 
assembled at the National Center to permit further dialogue with experiential learners and facilita- 
tors. The programs represented were cooperative education, Experience-Based Career Education, 
Executive High School Internships Program, Venture, apprenticeship programs, 70001, Occupa- 
tional Work Adjustment, Occupational Work Experience, and CETA programs. 
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SYMPOSIUM 

PROCESS 



Following this RKporiencG, the writors wero dskiid to preparo pupors outlining ( 1 ) their cpistc 
mological perspective on iinderstanding and examining natural phenomena of experiential educa- 
tion, (2) a range of possible consequences that might stem from Gxperienlial education programs, 
and (3) the strategies they would undertake to confirm or deny the truth of these p issiblo con?e 
quences. 



Structure of the Symposium 

The Symposium was organized around four major activities that were repeated for each per^ 
spective. The activities were: 

1. Presentation of perspective 

2. Small group discussion 

3. Feedback session 
4 Peer summation 



Presentation of Perspective 

Each author presented his/her viewpoint on understanding the phenomena of eKperiential 
education and investigative techniques that could be used to evaluate the consequences of experi 
ential educafion. The final papers differ slightly from the presentations. 



Small Group Discussion 

After the presentation, participants selected one of four groups (Figure 1 ) in which to discuss 
the perspective. Each group represented a particular viewpoint: 

9 Evci/uator-Conceptua/izer: This group was primarily concerned vi'Ith theoretical considera^ 
tions of evaluation practices such as epistemologicaLquestions, research paradigms and 
alternative evaluation designs, 

• Evaluator-Action Oriented: This group was primarily concerned with practical questions 
of evaluating experiential education programs such as instrument development and credi- 
bility of evidence. 

• Experiential Educator^Conceptuaiizer: This group focused on theoretical considerations 
for experiential education such as pedagogical assumptions, learning theories and career 
development theories. 

• Experiential Educator-Action Oriented: This group had as a major interest the practical con^ 
cerns of directing programs, such as curriculum scope and sequences and interaction with 
the community. 

After assuming one of the four roles, each group was encouraged to discuss the perspective 
using five phrases as orgenizers: 
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Figure 1. OrpnizitionofSmilf Groups 
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SYMPOSIUM 
PROCESS 



• Right On: Indicated enthusiastic agreement. 

• Veah, but: Indicated that some of the points may have had limitations. 

• No way, becau$e: Indicated that the point made appeared to be non-applicable. 

• Write on, say more about: Indicated that the point was valid but more needed to be said. 

• Monday morning, to do: Indicated thoughts the group had for putting a theory into 
practice. 

These five phrases proved useful in helping the groups focus on the major parts of the perspective. 
Feedbad< Session 

A member of each group was chosen to summarize the group's discussions and conclusions. 
This encouraged dialogue within and across groups and with the authors. 

Peer Summation 

In order to round out each perspective and bring that section to a close, an individual who 
represented the discipline and who had considerable experience with experiential education pro= 
grams summarized the major parts of the presentation and the feedback. 

Organization of Proceedings 

The Symposium Proceedings are organized in the same order as the symposium. They begin 
with the Keynote Addreis. This is followed by a section for each perspective: Psychology, 
Economics, Anthropology, and Sociology. Each section begins with the ma^or presentation, fol- 
lowed by a summary of the feedback session, and concludes with the peer summation. The final 
section offers two reflections on the Symposium. 

We encourage the reader to browse through the topics and then enjoy the diverse and pro^ 
vocative papers. The reader might find it useful to assume one of the small group roles as he/she 
pursues each section. 

Appendix A contains the Symposium Agenda. Appendix B has the list of participants, and 
Appendix C prbvides biographical sketches of the authors. 
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KEYNOTE 



ALTERNATIVE PERSPECTIVES 
ON INVESTIQATING THE CONSEQUENCES 
OF EXPERIEi. I lAL EDUCATION 

The Truth About Consaqutn^s: 
I Th& Rac^ Is Not to the Swift 



Richard Graham 
Youthwork, Inc, 

My Job is to give the Keynote, to be the pitchman for this Symposium. Then you are sup- 
posed to do the singing. Do you know what a symposium is? It's a drinking party where there is in- 
tellectual discussion. 

Let us come fill the coffee cups and begin. As you may know, the most noted symposia have 
dealt with love. We are here, perhaps, because of a love of learning, but like other matters of love, 
the consequencr hard to anticipate, Our topic is the consequences of experiential education 
and you have i . ; several people to provide differing intellectual perspectives, psychological, 
economic, anthro^wiogical, and soclologlcaL You have, It seems; omitted the philosophical, and I 
would like to compensate for that omission. For the philosopher Is one who devotes oneself to 
fundamental truths, in this case, the truth about consequences. Our philosopher might then begin 
the dialogue In this fashion: 

Agonese, would you say that experiential education Is all of education or a 
part? 

Clearly it is a part. ■ "> ' 

If it is a part, what is its relation to the whole? What difference does experience 
make? 

You have earlier persuaded me that experience makes the difference between 
true knowledge and right thinking, that if someone tells me the way to where I 
want to go, I may think rightly about it, but If I travel that road for myself, 
I know truly the way. 

Must you then go everywhere yourself? 

I think not. But if I am told many things and can test the truth of some by 
experience, then perhaps I can better judge the truth of others. 

Well, then, if experiential education is a part of all education, does it have the 
same aims as the whole or differing aims? 

It must have the same. 
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Philosopher: 

Agonese: 
Philosopher: 

Agonesa: 

Philosopher: 
Agonese: 

Philosopher: 

Agbnese: 



THE TRUTH ABOUT CONSEQUENCES: 
THE RACE IS NOf TO THE SWIFT 



Philosophir: Then experiential education must be able to itate iti aims because if it does 
not know where it Is heading. It does not know when it gets there. 

Agonise: There can be no question about it. 

Philosopher: What then ought.to be the aim of experlenttgl education? 

Agonese: Surely It must be a good life, 

Philosopher: Would you say a good life or the good life? 

(pause) 

Agonese: I would say the good life. 



Philosopher: And whut would you say Is the essence of the good life? 
(long pause) 

Because it is only a two-day symposium, It Is better to take leave of our philosopher and his 
Agonese. It is better to turn now to our sociologist, anthropologist, psychologist, and economist 
who, whatever their concerns for what ought to be, can certainly help us with what is; But, before 
doing so, I want to suggest a row perspective, on experiential education, one thatjs concerned with 
educational progress to be sure, but one which Is more than usually concerned with changes of 
direction along one's route, with the critical Incidents that change one's life, and with the ways to 
improve one's chances for the good life. For the truth about consequences according to 
Ecclesiastes Is 



The race Is not to the swift 
" Nor the battle to the strong 
Nor bread to the wise 
Nor riches to the Intelligent 
Nor favor to men of skill 
But time and chance happen to them alL 

The desired consequence of eKperiential education in this perspective is to increase one's strength, 
intelligence, wisdom, and skill to be sure, but most of all to improve one's chances. 

We know from our own lives and those around us how chance events, the fortuitous and the 
setback, affect what we do and what we become. We can, with only a little reflection, Identify the 
persons and events that have most affected us-events like having someone take a special Interest 
in us, finding a mentor or model, moving to a new neighborhood, being taken Into a new group of 
friends, getting married, having a baby, being exposed to a new field, business, pursuit, or discipline, 
reading a new piece, suffering an accident or illness, getting into a good school, camp, or college. 
External events-war or depression-may provide a chance to start over or require It. You can add 
others and I am trying to do so In a longer paper on critical incidents and how to contrive them. 

In one of the more thoughtful of recent attempts to get a picture of what happens to us as 
we grow up, Christopher Jencks developed some path models based upon a great deal of research. 
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KEYNOTE 



The models attempt to show the relationships betwesn one's family background, aptitude, test 
scores, how far one goes In school, the kind of job one gets and the income one makes (see Figure 
2), Jencks noted that while our inheritance, and education affect what becotnes of us, luck and 
cliance seem to have greater effect My own belief is that good education will contrive luck but that 
bad education does not. I believe that our reisarch has failed to look at the cause and consequences 
of the things that most affect our lives, I would prefer a path model that gives a greater place to 
experiential learning (see Figure 3). 1 don't suggest that we diminish our efforts to develop measures 
for the qualities of strength, intelligence, wisdom, and skills that predict, however feebly, to the 
things associated with a good life. I do suggest we also develop ways to assess the critical Incidents 
that can be brought about by experiential iearning. I believe we can find ways to reduce the effects 
of time and chance on our lives, 1 believe that we can contrive critical incidents to a far greater 
degree, contrive both their number and their character. It is one of the disappointments of eKperl- 
ential learning, the Outward Bound program for example, that although those close to the program 
know thit it can have a profound effect on one's life, evidence ^o support this is hard to come by. 
It can, I believe, be accounted for by the fact that an experience of this kind may have little im- 
mediate effect but can have a pronounced change on the direction one's life takes, a change that 
will have measurable effect later on. I believe that evaluation of critical incidents is particularly 
difficult because just one experience, no matter how well contrived, will not with any assurance 
bring about a change in direction. What is needed is a succession and variety of experiences so that 
the chances become greater that the right kind of experience will occur at the right time for a 
particular Individual. 

Some of the people here at the symposium will have something to say about the nature of ex- 
periences that tend to have good effects. The level of responsibility that one can take on and the 
character of the relationship between teenagers and idu|ts, are among the things that the people 
who run programs say are most impbrtant and those which the teenagers whom Tom Owens sur- 
veyed in the Experience-Based Career Education programs say are the most important. 

This is my Keynote. I hope that we will be a singing group. I would like to return for just one 
moment to our philosopher. 

Philosopher: Now Agonese, did we agree that experience leads jo true knowledge and helps us 
test the truth of what we are told? 

Agonese: Yes, I am persuaded of it. 

Philosopher: And did we agree that education through experience should be measured not so 
much by the progress one make ng une's way but by the degree to which it 
redirects us towards a good life" 

Agonese: I think we' agreed to that but I need more time to think about it. 

Philosopher: And Agonese, did we also agree that it was not enough to educate for a good 
life, for status and income, but also for the good life, the life of duty as citi- 
zen and parent, os one who sees it is one's duty to ^eek justice and to seek a 
just society? 



Agonese: 



Yes, Philosopher, we did, I guess. 



Fiiuril JENCK'S PATH MODEL 
■ TIME (OR LUCK) I CHANCE 
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THE TRUTH ABOUT CONSEQUENCES: 
THE RACE 1$ NOT TO THE SWIFT 



Philoiopher: And what is the essence of justice, of a just society? 

Agonese: Surely It is that there are equal rights and equal opportunity and one person 
should not profit at the expense of another. 

Philosopher: And how should one determine whether there is education that provides equal 
access to employment and the other things which lead to the good life? 

Agonese: Surely in part It is bv whether the differences in employment are not based on 
race or sex. That could not occur in a society that educates for justice. 

Philosopher: And if Black youth are having less access to employment than they did 10 

years ago, less participation in the labor force, would you say that our society 
is becoming more just or less just? 

Agonese: I had been thinking that our society is becoming more just but if things are 
getting worse for Black youth, it cannot be so. 
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PSYCHOLOGICAL PERSPECTIVE 
ON INVESTIGATIISIG THE CONSEQUENCES 
OF EXPERIENTIAL EDUCATION 

Evaluatiny Exparjential Educations 
Which Part of the Elephant Should We Study? 

Samuel H. Osipow 
The Ohio State University 

Evaluation research always presents very special problems. The word evaluation has some 
connotations which contribute to the special problems of evaluation research. According to my 
dictionary, to evaluate is defined as to determine, set the amount of, or to appraise. 

The definition impHes not only the connotation that the results of the process of evaluation 
will describe the outcomes in terms of the adequacy of achieving some objectives, but it also in- 
eludes judgments about the utility, value, etc. of the objectives themselves. Therefore, In evalua^ 
tion research one needs to distinguish between the activity in terms of its adequacy defined in terms 
of meeting stated goals (methods), and adequacy in terms of social utility (inherent value). 

Were these the only problems associated with evaluation research, we would be in sufficient 
difficulty to be uncomfortable, As it is, additional problems plague us as well. Most evaluation re^ 
search projects are conducted in a field setting. Field settings involve uncontrollable variables, un- 
controllable stimuli, uncontrollable outcome measures, heterogeneous populations, and hetero- 
geneous deriverers of the intervention under evaluation. 

Knowing this we continue to engage in evaluation research partly because custom requires it 
and partly because the heavy investment of society In programs requires us to do what we can to 
assess the outcomes of our efforts. 

With respect to experiential education, the problems mentioned above abound. First, an ade= 
quate definition of experiential education is required. Putting the two key words together' (experi- 
ential and education) we get: 

pertaining to or derived from experience (personally encountering something) 

and 

the act (process) of imparting . . . general ... or specific knowledge . . . 

Thus, together there is the element of acauiring knowledge through personal encounter 
rather than remote or vicarious exposure, 

Second, we recognize that experiential education can occur In a wide array of contexts and in 
connection with very heterogeneous populations. Just a brief exposure to several models associated 
with experiential education rovoals that for some, experiential education involves exposure to the 
world of work in very limited structured ways. For others it involves a very eKtenslve processing of 
that interaction. 
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Experiential education can occur at a variety of developmental periods. For some individuals 
it occurs during the high school years, for others in college, and for others even beyond. 

The outcomes desired for experiential education vary, largely as a function of all of the above; 
that is, the population, the developmental stage of the student, and the purposes for which the pro= 
gram has been designed. In considering what would be a useful approach to the task of writing the 
present paper, I decided to focus only on the career related aspects of experiential education. This 
decision reflects partly the emphases of the programs that the National Center displayed in orient* 
ing the panel to the task as well as my own research and writing, which has focused on career de- 
velopment Of course, experiential education has implications other than the career development 
context 

Intuitively, experiential education makes sense. Objectively, as with most social interventions, 
experiential education is difficult to justify with hard data, 

I would suggest that one first step in dealing with these limitations involves specifying the 
theoretical context within which we wish to understand how careers develop; the second step Is 
specifying how experiential education may contribute to the development of careers with the 
chosen theoretical context. More specifically, were we able to identify constructs associated with 
effective functioning in one's prevocatlonal or vocational life, we might be more successful in 
tailoring objectives, criteria, and methods to assess outcomes associated with these constructs than 
by simply accepting the notion that experiential education can be assessed in a field setting without 
a theoretical rationale. 

To that end, in this paper I propose to briefly describe four contemporary approaches to 
thinking about how careers develop and to briefly show how these four conceptions might relate 
to evaluations of experiential education in terms of the appropriateness of populations to be 
studied, the objectives of experiential education within the framework of each approach and a tar- 
get population, and criteria for assessing th^ outcomes of theoretically based Interventions associ- 
ated with a target population. ; 

I 

The four theories that I will describe and try to apply in this fashion are the Work Adjustment 
Theory (Lofquist and Dawis, 1969), Social learning approaches to career behavior i^est exempli^ 
fifid by Krumholtz, et aL, 1976), Super's Career Development Theory (most recent! / fully described 
in 1963), and Holland's Person Environment Theory of career development (1973). 

Theories 

The first of the career development theories to be considered to evaluate experiential educa= 
tion is Super's theory (1963). Super has proposed a general model of career development which 
includes two basic elements: Self concept implementation through career and the progress of the 
indivifiual through a variety of developmental stages, each associated with the acquisition of specific 
vocntif)nal and prevocational related skills. 

The dovclopmontnl omphasis of the approach speaks tu.llie tjuesiiun uf expec:tcitions society 
holds al)out flow the individual should l.iehave at various times and what decisions, skills to imple^ 
ment thnse decisions, and oLitcomes in terms of [jerfnrmrinco capabilities the infliviflunl should havfL 
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The self-concept aspect of the theory speaks to the quistion of the underlying continuity of the 
individuars career related behaviors through the life span. In other words, while specific behaviors 
the individual engages in while in the career as opposed to the prevocational decision stage might 
vary, the unifying element is the fact that fundamentally the individuars self-concept is stable (or 
at least changes very slowly) and thus allows the prediction of individual behaviors at various times 
of life to be nnade with the expectation of some accuracy. 

Super specifies the vocational stages in moderate detail; one focuses on the late adolescent 
period. For eKample, one would expect a number of rather specific events to be occurring which 
might have relevance for experiential education during the ages of 14 to 18. Furthermore, these 
would be somewhat different than those vocational development events that are expected to occur 
between 18 and 22 years, and so on, 

In sum. Super's theory applied to experiential education logically leads to the design of experi- 
ential education programs with the acquisition of fairly highly specific vocational developmental 
skills in mind. Thus, these skills which have been detailed, could lead to program desigr llowing the 
evaluation of the program's impact on individuals in terms of the specific skills predict The self- 
concept component is less important in the design and evaluation of experiential edL pro- 
grams from Super's persp ;ctlve, although a sub-dimension of self-concept, self esteen , t be 
expected to be modified as a function of experiential education and this could be still u o^> 
feature to be examined as an outcome variable. 

The second conceptual approach to career development that might be applied to the assess- 
nent of experiential education has been proposed by John Holland (1973). Holland's theory is a 
person-environment approach to understanding how people select and function In career areas. 
According to Holland, people are motivated to find a congruence between themselves and their 
environment in terms of six personality types and six corresponding work environments Holland 
has proposed. Ultimately, the criterion of the theory rests on the degree to which the person finds 
a suitable match between the environment and his or her personality type. 

Thus, one principle element sought is a process by which the individual can explore work en- 
vironments and determine the degree to which various possibilities are indeed a good match to per- 
sonality. Applied to experiential education, the principle focus would be on the exploration of 
work environments in terms of environmental and Interpersonal characteristics in order to find 
those that would or would not be congruent with the individuaTs personality. The criterion for 
Holland's tfieory is the prediction of a specific career choice in terms of a field which is presumably 
a good match; this objective contrasts with Super's mode! which tries to predict not so much a 
specific choice but rather aims to improve the process by which the decision is made* 

The next theory that may be considered is the Work Adjustment Theory proposed by Lofquist 
and Dawis. Lofquist and Dawis tried to develop a trait oriented approach to predict work assess- 
ment In terms of job tenure. They based this theory on several assumptions. Hirst, they assumed 
that individuals seek to achieve and maintain a correspondence between their work enviror ment 
and their personal characteristics. (This is similar to Holland.) The correspondence is reflected in 
job tenure, where tenure Is a function of the individual and the environment, t - f(l ^ E). 

To the denree that the Individual is able to maintain equality between him/hcrsolf nncl tho 
environment, the individual will bo satisfied and will be satisfactory in porformanco, Sntisfactori 
ness is defined nxlernully In terms of quality of porformanco and nccoptability to others* 
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Satisfaction is defined internally in terms of the degree to which the work process and the work 
setting provide desirable outcomes for the indivlduaL Thus, in contrast to Super's theory which 
focuses on the choice process and Holland's theory which focuses on the choice content, the 
Lofquist and Dawis theory focuses on work stability. 

Lofquist and Dawis speak to the question of how the individuaTs work personality develops. 
They propose that on the basis of a recycling series of events beginning at birth, the individual 
develops a unique set of individual needs which are differentially reinforced by different work, 
school and social environments. Between the early school years through the end of high school and 
leading to employment a correspondence, or lack of it, between the individual and the work or 
school environment becomes increasingly Individualized, differentiated, and complex. Considering 
experiential education in terms of Lofquist and Dawis' approach would require the assessment of 
the potential psychological needs, potential ability demands, and the correspondence between the 
two that any given work situation generates for an individual. Experiential education for the late 
adolescent then would focus on the identification of a degree to which the individual is able to 
function satisfactorily and with satisfaction in the work situation. 

The last of these theories I would like to suggest for consideration of our purposes is the Social 
Learning approach to career development (Krumboltz, et aL, 1976). This approach is based on 
interaction between genetic factoN, the environment, learning, cognitive emotional responses, and 
performance skills. It assumes that at each decision point the decider has one or more options and 
that the personal environmental factors noted above shape the number and the nature of these 
options as well as the responses the individual can bring to bear in dealing with them. 

The four ingredients of choice are genetic endowment and special inherent attributes such as 
race, sex, physical appearance, etc. The second ingredient includes environmental conditions and 
v^vents such as social, cultural, political, and economic factors. The third ingredient consists of 
learning experiences of an instrumental variety where an individual acts on the environment and of 
an associative variety where the Individual reacts to stimuli. The fourth set of ingredients are the 
task approach skills which each individual brings to bear to any new task. These are defined in 
terms of work standards, values, work habits, and cognitive processes and so on. 

The approach focuses on three sets of propositions which deal with how careers are planned, 
how career responses are acquired, and how implementation responses are acquired. The approach 
is largely a reinforcement approach which differentially speaks to the question of the indivlduars 
development of a preference for a particular career area In terms of having been reinforced for 
associated activities, seeing models reinforced for associated activities, for having models reinforce 
the individual for indicating an interest in associated activities, and for exposure to positive stimuli 
associated with particular activities, A corollary set of propositions In terms of the negative possi- 
bilities is similarly proposed. A second proposition set deals with how the individual learns the 
Cognitive performance and emotional responaes needed for individual planning, again in terms of a 
decreasing hierarchy of direct reinforcement and vicarious reinforGement, 

The third set deals with how the individual learns to implement a preference, again in terms of 
a descending hierarchy of reinforcement associated with actions of an implementation sort 

Here the focus is on learning a sequence of skills appropriate to the arrangement of relevant 
career decision and implementation activities. Applied to an experiential education context, this 
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approach would lead to the specification of the particular skills and behaviors desired in a given 
work setting and the presentation of appropriate reinforcements for the individual who engages 
in the appropriate responses in order to develop and shape the desired behaviors. 

Applications 

In terms of the four theories stated above, th^ following similar statements can be made along 
several key dimensions. We can speak about the general goals of the theory; the goals in terms of 
what should be occurring during the 14 to 18 year age period (the principle period associated with 
most of the experiential education programs); the kinds of methods that would be tied to the 
theory; and the criteria for evaluation. 

If we wanted to extend experiential education into the 18 to 22 year period, we might have 
to revise somewhat the goals and since there are many experiential education programs conducted 
at the university level, this might be worth doing. However, what follows below is designed more to 
be an example of how one might proceed than it is to be a final and defensive statement of goals, 
methods, and so on, tied to theory. The objective of this exercise is to demonstrate how to begin 
to design an evaluation or assessment component associated with an experiential education project 
that would be related to a particular conception of what should be going on in career development 
during a particular period in time related to a particular set of activities, and related to a particular 
set of outcomes. 

Super's theory has as its general objectives the development of decisional skills. During the 14 
to 18 year period the goals associated with Super's theory are a general furthering of vocational 
maturity. This vocational maturity can be seen in several specific behaviors such as the development 
of exploration skills which result In an accumulation of self and environmental knowledge; the 
development of implementation skills, that is identification of and acquisition of associated skills 
related to putting into action decisions that are made, and a reality testing dimension, which is 
associated with the collection of data concerning one's progress and adequacy having implemented 
a decision and assessing the data. 

In terms of methods associated with experiential education deriving from this position, several 
possibilities occur. First and foremost there would have to be some cognitive component so that an 
individual in experiential education would have some overview of what the experience would pro- 
vide in terms of the general developmental age-related, stage^related goals. Secondly, particularly at 
the early ages=14, 15, and perhaps 16— there should be a sampling of work activities or experiential 
education activities so that the individual can begin to differentially relate his or her persona! 
adequacy and satisfaction to a wide range of occupational possibilitys. This sampling should begin 
to narrow toward the end and perhaps become even more specialized at the 17, 18, and beyond 
level as the individual has accumulated some feedback data regarding his/her adequacy in eKperiential 
education. 

In addition, there should be systematic and objective feedback associated with the experi- 
ential education so that individuals learn not only how satisfied they are with the activities, but 
along what dimensions this satisfaction exists, and how it varies along the dimensions. Finally, 
there should be some performance feedback for the individual. 
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The criteria that can be used to evaluate experiential education from Super's point of view 
would be exemplified by the following; (1) How much information does the individual actually 
havp subsequent to the activity about the occupational areas in which he/she was engaged? (2) What 
kinds of vocational maturity gains have there been in terms of such things as scores on the Career 
Maturity Inventory, or the Career Decision Scale (Oslpow et al., etc.)? (3) What kinds of imple- 
mentation and decisional skills does the individual have that can be brought to bear at the next 
stage of decision making? 

Holland's Theory 

The general goal of Holland's theory is the development of a congruence between the indi- 
vidual and the environment. Specifically, during any age period individuals have the goal of identify- 
ing the optimum environmental match for their personality type. At the 14 to 18 year period this 
optimum matching process would be reflected in terms of eKploring the various environments in a 
manner similar to the way Super describes, through a sampling nf work setting activities but not an 
immersion in a particular single activity. However, this sampling would be focused on those activi^ 
ties that fall into the individual's general high point career area, rpther than be buckshot across-the- 
board sampling. Super's sampling, in contrast, might be broadGr m nature, 

The methods used would be largely competency stretching; efforts to engage the individuals 
in activities which will broaden the range of competencies and types of activities that they have 
experienced and have perfected. 

The outcomes of the objectives can be assessed in terms of improvements in the match be- 
tween the individuaTs environment and the individuaTs personality type. Measures such as the 
Self-Directed Search and the Vocational Preference Inventory, both instruments tied to Holland's 
theory, would be pertinent used in conjunction with the Job Finder, also developed by Holland, 

The Lofqufst and Da wis theory has as its general goal the development and prediction of job 
tenure in the individual. Lofquist and Dawis assumed that to the degree that the individual is well 
suited for an occupational activity, job tenure will be longer. More specifically, during the 14 to 18 
year period, the individual is developing a work personality which will plug into a general equation 
leading eventually to predictions about job tenure. During this period of the development of the 
work personality, the individual is acquiring knowledge about and getting feedback about personal 
abilities, job ability requirements, personal needs and the needs satisfaction potential of various job 
and scholastic activities. 

Applied to experiential education, the methods involved would include sampling a wide range 
of activities and identifying how one stands with respect to abilities, needs, and productivity in 
various work and school types of settings. 

The criteria would be increased knowledge of work requirements in terms of ability demands, 
increased knowledge of the needs potential of a variety of work settings, and increased self knowl- 
edge concerning ability and needs potential. These can be measured by a variety of instruments 
associated with the Lofquist and Dawis theory, such as the Minnesota Satisfaction Questionnaire, 
the Job Description Questionnaire, and so on. Ultimately, one is trying to predict occupational 
satisfaction and occupational satisfactoriness. This can be enhanced (in the 14 to 18 age range) 
through experiential education by means of helping individuals process the needs ability riimen 
sions for themselves and for the world around them. 
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The Social Learning theory, best exemplified by the work of John Krumboltz, et al., has the 
general objective of the development of decision making skills. More specifically, at any age range, 
decision making skills involve an information search which leads to the generation of as many alter- 
natives as possible followed by an identification of the most satisfactory outcomes of these alter- 
natives. The methods primarily involve the impact of real role models and reinforcement of 
appropriate behaviors. The Social Learning method lends itself especially well to the experiential 
education format in that the workers and supervisors provide excellent potential role models and 
also provide excellent potential reinforcing agents when behaviors are exhibited that are desirably 
reinforced. The outcomes associated with this approach are primarily the generation of increased 
numbers of alternatives and increased skill in evaluating these alternatives. Ultimately, an Improve- 
ment in decisional skills in terms of greater reality, generating more alternative possibilities, and so 
on would result. 

There is a great deal of overlap and similarity in the general terms associated with these 
theories. What is important to recognize is that with some considerable analysis and attention it 
is possible to devise a somewhat different orientation towards experiential education in the context 
of each of these different approaches. The details associated with what one would be trying to 
accomplish at a different age range than the 14 to 18 period might be slightly different from each of 
these perspectives. What would be clearly different would be the kinds of measures of the outcomes 
that are desired and tnis would be associated with some slightly different sets of objectives such as 
with decisional skills in terms of Super and Krumboltz, information about self in terms of Lofqulst 
and Dawis, and identifying work environment directions from Holland's perspective. Depending 
upon your objectives, depending upon the conception held of what is appropriately done at a given 
age range, one will have different kinds of methods, or will use different kinds of methods, and will 
assess them differently. 

What is also important from this perspective is that there has to be a cognitive processing 
dimension which accompanies experiential education so that the student doesn't merely get thrown 
into a work setting but is eKposed to a systematic and consistent opportunity to discuss, to think, 
to analyze, and to observe the e?rperience that he/she is having in terms of the kinds of objectives 
and criteria that are desired under the guidance of a professional educator. 

Another feature to be noted Is that there may be different kinds of students who would profit 
differentially from experiential education emphasizing each of these different theoretical ap- 
proaches. In other words, one student might gain more from an experiential education based on 
Holland's theory whereas another might do better from the Social Learning or the Lofquist and 
Dawis or the Super approach. It is even possible that an individual at one stage might best profit 
from a Super-oriented approach and at another stage that same person might profit more from 
another approach. Overall, using a theoretical conception offers the possibility or increases the 
possibility of individually tailoring programs to meet student individual needs. 



Some Additional Considerations 

In terms of evaluating any intervention program, there is another set of issues that has to be 
considered. Experiential education has problems which parallel those of counseling and psycho* 
therapy outcome studies. One of the problems that has been encountered by many psychologists 
in trying to evaluate and assess the outcomes of counseling and psychotherapeutic interventions 
has been that when group data are aggregated many of the gains that are made by individual clients 
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are cancelled because one client's goal is another client's deficit. When we combine client goals and 
attributes we often discover that we can measure no net change for the group. In other words, we 
may be counseling one student to become more socially skilled and to interact nnore with people 
and another student to focus more on academic performance. We might discover that the socially 
active student who seeks to develop better social skills. finds his or her grades going down while the 
other student's grades go up but social skills decrease. If we use grades and social skills as criteria 
for both students they will end up with the net of zero change. What we need to do is to use indi- 
viduals as their own baseline control and then aggregate in terms of the particular objectives that we 
are trying to achieve. We should avoid trying to measure abstract and trait^oriented constructs 
such as personality change) partly because these are difficult to measure validly and reliably, and 
also because most of our interventions, even assuming the validity of personality organization as an 
outcome goal, are not likely to have much impact on those constructs. What we need to do is make 
explicit the kind of changes we wish to achieve for each client or class of students and work to 
measure that particular behavioral change. 

Experiential education has the same set of problems. One student's need may not be the same 
as another's. We must tailor our outcome measures to the kinds of needs that we see individual 
students displaying and then evaluate the interventions in terms of those needs and aggregate only 
common objectives and not across objectives. In particular, we should avoid using as outcome 
measures abstractions such as personality traits and so on unless we have specific reasons to have 
decided that those are the objectives we wish to focus on. 



Recommendations 

In reviewing the four theories I have presented to illustrate how one might conceive experi- 
ential education programs from a career development theory framework, several implications 
seem evident. First, the age range on which one chooses to focus would appear to be significant 
in selecting a theoretical framework. In my opinion, the 14 to 18 year range for programming might 
best apply some aspects of the Lofquist and Dawis framework. Here the criteria for personal de^ 
veKipment in terms of exploring needs and abilities and measuring improvement in terms of the 
extensive series of instruments that Lofquist and Dawis have developed would be very applicable. 
Programmatic experiences could be planned in terms of self exploration and environmental explora- 
tion and growth and change could be measured very easily. For the 18 to 22 year age range the 
framework proposeo by John Holland seems to me to be very apropos. Here, exploration of new 
fields and environmtmts and an accelerated assessment of one's competencies would seem in order 
as a program guide. The instruments that Holland has developed and modified, such as the Voca- 
tional Preference Inviintory, the Self Directed Search, and the Holland Scales on the Strong^ 
Campbell Interest Inventory, all provide handy devices to measure outcomes. 

As an overall framework, social learning theory seems very apt, but seems most useful in plan^ 
ning individual experiential education programs where the task is to find a way to individually 
tailor an opportunity to explore the work environment. The social learning approach seems useful 
in its emphasis on individual as opposed to group process. 

A word is also in order in terms of the exclusiveness of the constructs that I have suggested 
in this paper. I have focused on career development concepts in psychology and not on the larger 
psychological theorit^s, such as social learning theory in general or other personality theories. I 
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have done so not becausf I think these other theoriis are inappropriate but rather bicau^ the 
career development theories have more heuristic value in planning experiential education programs. 
A creative psychological theorist m ght very well choo^ to build expirlentlal programming on the 
basis of more fundamental piychobgical theories than I have chosen to do in this particular effort. 



Summary 

What has been proposed here is a conception of experiential education based on career de- 
velopment theory. Any such conception can lead to a program, objectives, and outcomes measures, 
that are logically related and Internally consistent, It is suggested thst such a strategy is more likely 
to lead to effective program assessment than strategies u^d heretofore, 
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The group's reaction to thii preientation led to 
the conclusion that for the practitioner there are at 
least three benefits in the use of a career development 
model: (1) what to look for, (2) how to organize the 
inveitigation, and (3) an ability to make seniibli 
choices about the instruments to use in the investiga- 
tions. On the practical side, the group wanted to 
know where to get the Instruments. Concern was ex- 
pressed with the limitations Impo^d by using one of 
the career models described by Dr. Osipow. The work adjustment theory and Holland's theory are 
all right if you are Plato seeking to pigeonhole people at four levels of the republic. But how can 
you pigeonhole people in our society where the marketplace determines what you will be five, 
ten, even twenty years from now? Another limitation of a career model Is that most school 
districts do not have unlimited resources for students to pursue the full range of career explora- 
tion and preparation. The group was also concerned that once a model would be chosen and imple- 
mented, practitioners would not like what was happening. It seems that the real payoff for knowing 
the effects of the programs on students is much farther down the line. A final concern was whether 
the use of the four theories requires planned cognition by the students so they can internalize 
what they learn. Would they generalize these abilities? 



EVALUATOR— 
ACTION ORIENTED 



EXPERIENTIAL 
EDUCATOR- 
ACTION ORIENTED 



The group discussed the usefulness of a sys- 
tematic design. However, if one chooies and imple= 
ments a career development model, many effects 
would only show up in a longitudinal study. A three- 
year follow-up on job placement Is nice, but as a 
program director you are lucky to have one or two 
years to show the funding agency that something 
is happening. This is especially difficult when the 
agency requires black and white evidence on affective 
outcomes. Another difficulty is going into the community and talking about models and conceptual 
designs. One measure being used is frequency counts, but they rarely satisfy school boards, who 
represent the heaviest firing lines faced by practitioners. School boards often ask for the kind of 
hard data that they do not even expect In their own professions. Part of the burden is not to 
succumb to such pre^ure. 
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The pragmatic conceptualizers got right down to 
the task; the consensus was remarkable. The group felt 
that a better definition of experiential education was 
needed and produced the following emphases; It em= 
phasizes the out of school rather than in^school, in^ 
formal rather than formal settings, hands-on learning 
experiences, learning through role models, relating to 
people outside one's age group. Concerns are broader 
than career development. Agreement was particularly 
strong that any conceptualization needs to pay close attention to expected outcomes. The psycho= 
logical theories presented should be useful in specifying outcomes, designing p ograms, and identi' 
tying the premises of those programs. The caveat was added that theor^fS have serious limitations; 
they include only their own view of the world. An attempt to defend t^^a imp!! jdtions of some 
theories might be uncomfortable. The group developed two areas on which the^ would like Dr. 
Osipow to elaborate. First, what other psychological theories should be harnesoGd for the task of 
articulating program characteristics and outcomes. Second, before we accept any one theory, an 
environmental impact statement would be helpful to avoid ending up with a set of outcomes that 
we might be uncomfortable defending. 



iXPERIENTIAL 
EDUCATOR— 
CONCEPTUALIZER 



EVAUUATOR— 
CONCEPTUALIZER 



Regarding the last idea presented, our group's 
example was that a program may begin with the stated 
goal of raising students' awareness level about career 
options, yet students emerge from the program with a 
solidified career goal or wanting to explore six or seven 
more options. Can these outcomes be defended? 
Second, concern exists about the relationship between 
theories and program implementors. Teachers, coordi^ 
nators, site people, and students may not understand 

the theories being used or the charge they have been given, which results in more difficulty predict^ 
ing outcomes. Is it wiser to use a theory with a fine focus or a broad perspective? Super and 
Holland's theories are perhaps too narrow; the social learning theories, more broadly stated and 
open, seem preferable. Third, to address definitional issues, the group proposes a four-celled picture 
in which con^quences have a positive or negative aspect in one dimension and intended or unin- 
tended outcomes in the other. It seems the emphasis is usually on the positive, intended cell, in- 
vestigating it via quantifiable research methods. Perhaps one could investigate the other three cells 
with qualitative data such as testimonials from students, teachers, parents, site personnel. A final 
issue raised is that experiential education can be viewed as a teaching technique rather than a 
philosophical entity. 
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Harold L. Henderson 
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\ 

It's a pleasure to be he^e to participate with you in this Symposium. I think that one of the 
very best decisions that was r^ade concerning this conference was having people like Dr. Osipow, 
who as you know was an editor of the Journal of Vocational Behavior, an author of many articles, 
the author of a one-of-a-kind book on Vocational Development, and more recently on Emerging 
Women, a very current lisue. Tr^e next best decision that was made here was to have groups like 
these sit together and discuss insights from sociology, anthropology, economics, and career develop- 
ment in terms of experiential education, Half in jest, let me suggest that the worst decision that was 
made was to have a reactor, who'comes on after the feedback of each of the groups! Utilizing the 
tremendous talent that has been gathered here and working with one another attach table, conclu- 
sions are drawn, and then we expect someone to come up here and add at least one more brilliant 
insight to those already given. Nonetheless, I still am delighted to be with you, I had one advantage 
over you; I received a copy of Dr. Osipow's paper last night, Some of his best material was left out 
in his presentation today. Although he did a very fine job, given the time limit, in hitting the high 
points, there were some subtleties and some other points you must read when you get a copy of 
his naper In it he closed his loops and drew his conclusions very nicely, 

There are two things that I want to ^y immediately which, while repetitious, belong in a reac- 
tioi or summary. In the opening remarks. Or. Oslpow discussed evaluation and experiential educa- 
tion giving very brief definitions of both, and I'd like just to add a couple of pieces of Information 
that we all know but sometimes forget, In view of the purposes of this conference and these open- 
ing remarks, let us make sure that we understand that it is not as though we have not been evaluate 
ing experiential education and with some degree of success. And let us make it very clear that 
experiential education is much, much broader than work-study programs. I think the evidence is all 
around us on both scores, Just to mention one set of formative and summative evaluations, as< 
accomplished by the four laboratories that developed one kind of experiential education, we know 
as a consequence of case studies, interviews, adversary hearings, audit activities, cost studies, and a 
tremendous variety of other types of evaluation techniques, that Experience-Based Education works. 
The Joint Review and Dissemination Panel from OE and NIE utilized these data and did approve 
the four EBCE models. 

The second bit of Information has to do with the depth and breadth of experiential education; 
I want to make sure that those of you who haven't read the literature be sure you read some of 
Grant Venn's remarks which have been published in many places, and while they deal more specifi= 
cally with work^study, also show the breadth of experiential education. Dr. Osipow suggests Experi- 
ential Education varies from "limited, structured exposure to%the world of work to extensive 
processing of that interaction,'' It can be much more. While Dr. Venn puts It Into a work-study 
perspective, he has shown that "it can become another way that youth achieves many learnings 
necessary to become adult in his work life as well as his personal and public life," as well as giving us 
a list of the multiple opportunities it provides for work experience learning. These include the 
young (1) testing their knowledge and skill in the real world, (2) being involved in consequential 
activities, (3) working with peers, (4) assuming responsibility for the welfare of others, (5) trying 
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out new social roles, etc. (1976). I am sure you noted from Dick Iraham's remarks this morning, 
that he has been a longtime student of action learning or experiential learning, that he has written 
voiuminous materials on the subject, and his conceptualizations extend way beyond work study. 

The reason why '^certain kinds of action^learning may have good and lasting effect is that they 
provide experiences in taking on new roles in society/' require new perspectives and go beyond the 
announced goals of the programs: increased career maturity, psychosocial maturity, self concept 
and achievement motivation (Graham, 1974), 

Morris Keeton, Robert Sexton, who is here, and others, have pointed out that ''experience" 
and "''^irning" were separated 700 years ago in terms of definitions, but actually vocational train^ 
ing, ; i training, apprenticeship relationships and even the earliest scholarly training (before the 
universities got hold of It) was indeed eKperiential. I have an interesting little quote here that I just 
have to force on you from Chlckering's recent little pamphlet (1977) in which, quoting Cyril i-loul 
on a highly experiential and competency based curriculum that existed among the knights of the 
Round Table, he points out: 

The Squire must be able to "Spring upon a horse while fully armed, to exercise himself 
in running, to strike for a length of time with the axe, or club, to dance and do somer- 
saults entirely armed except for his helmet, to mount on horseback behind one of his 
comrades by barely laying his hands on his sleeve; to raise himself betwixt Wo partition 
walls to any height ... to mount a ladder . . , upon the reverse or underside, solely by 
the aid of his hands ... to throw the javelin and to pitch the bar (Keeton, 1976), 

Other formal applications of Experiential Education: there is the Cooperative Asse^ment of 
Experiential Learning project, CAEL, begun in 1973 and at the university level, and there is Phi 
Delta Kappa's Walkabout; in fact there have been a host of programs, most of which whether by 
testimony or by somewhat harder kinds of evidence, have been judged successful. 

I am sure all of you know that experiential education dates at least back to John Dewey. 
Dewey pointed out as early as 1916 that, 'There is a strong temptation to assume that presenting 
subject matter in its perfected form provides a royal road to learning." and again, "Only in aduca- 
tion, never in the life of a farmer, physician, laboratory experimenter, does knowledge mean 
primarily a store of information aloof from doing." Whether one uses Dewey or Jean Piaget or 
Jerome Bruner, one gets solid psychological and educational theoretical constructs for supporting 
this kind of education. 

On the other hand, I recently picked up a 1971 textbook on contributions of psychology to 
education from Columbia University, by most of their best professors; there's not one single refer- 
ence in it to experiential education, in spite of the fact that some of the early believers in learning 
by doing actually had taught at one time or another at Columbia. I bring that up as the excuse for 
reminding us all once again of the solid theoretical constructs, and historical supports that exist 
for Experientical Education. 

Now I want to react a bit to Dr. Osipow's concise and useful summaries of several care^ 
development theories. First, 1 was particularly pleased at his selection and his helpful abstraction of 
ideas most relevant to experiential education. I am proud to have been a part of the Career Pattern 
Study team in its earliest days, to have had Dr. Super as my mentor and friend, and to have con- 
tributed a thesis on father=son identification to Don Super's 1963 self-concept monograph. 
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Of course, many theories have been proposed m the last 50 years to explain parts of vocational 
choice and job success, John Crites has reminded us that vocational development theory building 
really did not begin with Eli Ginzberg in 1951, although during the next 10 years more than a 
dozen theories had been published in the literature. 

Many theories have also been proposed over the years to explain not just career development 
but human behavior. Not too long ago some theorists believed that the major determinants operated 
below the level of consciousness and took the form of needs, drives and impulses. Those theories 
liaye been criticized on conceptual and empirical grounds. Eventually we have properly invoked the 
scientific method and established stringent requirements for evaluating explanatory systems. We've 
said theoi ies must demonstrate predictive power. They must accurately identify the determinants 
of human behavior as well as discovering the intervening variables or mechanisms responsible for 
behavioral changes. 

The purpose of that little excursion into theory^building generally or into theories of human 
behavior generally is to make the following statement: that as much as I admire and respect Drs. 
Super and Krumboltz, and as much as I believe in self^concept theory in decision making and rein= 
forcement theory as useful for studying, researching, and understanding career development itself 
and the stimuli for counseling relationships, I don't see these theories or any of the others in career 
development as sufficient for the study of evaluation of or the construction of curriculum in ex- 
periential education. 

It seems to me that something like Albert Bandura's social learning theory which really can 
encompass Super and Krumboltz and goes beyond, is very much in order. Youil hear phrases, if 
you use Albert Bandura's theory, that fit very nicely into Super's and Krumboltz's, dealing with 
three useful dimensions of the meaning of work: setting, the form of activity and the consequences 
of activity. Phrases like modeling, level of activity, individualization, self^management, the conse- 
quences of behavior, observing others, role models, communicating, learning by doing, self-reliance, 
attention, punishment, reward. All of these are phrases common to both experiential education and 
social learning theory. They can cover not only career development but life development as well. 
Norman Gysbers suggested the need for breadth in XhB Personnel and Guidance Journars special 
issue about three or four years ago, and I'm quoting now from the introduction that Gysbers and 
Moore made to that May, 1975 issue: 

Although current career development theories are more appropriate than traditional 
ones, most still separate individual's work roles, settings, and events from other roles, 
settings, and events in their lives. Because of the increasing complexity and inter= 
relatedness of all aspects of society, it no longer seems possible to clearly separate 
one role from the other, one setting from another, and one event from another. We 
are thus proposing that the meaning of career be expanded to encompass individual's 
total lives. [Many] have indicated that the concept of career encompasses t variety 
of possible patterns of personal choice related to each indlviduars total hi'f style; 
its components are occupation, education, personal and social behavig^, lo^^ning how 
to learn, social responsibility, and leisure time activities, (Vol. 53, No. P, 648) 

Nor would Manaster see career development theories as broad enough for experiential educa= 
tion, since Manaster (1977) separates the demands made upon adolescents into developmental tasks 
and life tasks. Others (Dinkmeyer and Carlson, 1978) have separated life tasks into (1) love and sex, 
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(2) work and school, (3) friends and society, (4) self, and (5) the meaning of life. Still others {e,g,, 
Gould, 1977) have identified the developmental tasks as sexual resolution, emancipation from 
parents, career goals, and personality integration, Havighurst (1972) has combined eight develop^ 
mental tasks and their associated life tasks. The noint of all this is, of course, that experiential edu= 
cation interfaces with both developmental and life tasks and is much broader in scope than career 
development. 

Before closing, Td like to deal for a few momenti with two vary interesting and useful insights 
provided by Dr. Osipow. I was quite struck by a phrase I read in full last night and heard a pi^ce of 
today, ''We need to use individuals as their own baseline control and then aggregate in terms of the 
particular objectives we are trying to achieve/' This to me is a trennendously insightful notion as to 
how to evaluate, particularly in areas like career maturity, where many people think students must 
improve their scores but others of us suspect it often shows progress if one changes his or her score, 
Perhaps the real thing you're looking for is change. Individuals who are too narrow broaden their 
horizons; individuals who are too broad begin to narrow their sights. After all, occupational choice 
is a continuing process even though counselors only discovered that about 30 years ago. 

Vocational development 'i^ory, then, is to my mind not a sufficiently general theory of de^ 
velopment, and can not serve as the sole basis for the evaluation of experiential education in all its 
versions with all its target groups and within the framework of life development. 

Another important point to be made, at least by implication, Is that it is not only in experi' 
ential education that we need individualized programs. We need the same thing for youngsters in 
terms of career development. Wliile it's tough to build practice that fits theory that itself fits the 
total experiential education alternative in a school system if every youngster is on a different path, 
in effect we are in EBCE doing it because we do develop individualized programs. So why not have 
the counselor and/or learning coordinator and/or facilitator and/or teacher involved in the con- 
tracting of programs with the youngsters, be so familiar with the details of several career develop^ 
ment and/or social learning theories, that he or she is able to communicate to the youngster the 
theoretical constructs within which the itudent/client appears to be operating? "Is this the direc- 
tion that you want to continue in? . , . Here are the kinds of things that you need in the way of 
experiences to fulfill this, etc." Thus, the facilitator and student achieve not only individualized 
academics but individualized career development as well. We do something like this in the 
Appalachia Educational Laboratory's EBCE with the Student Career Guide, .. 

The paper and pencil tools for collaborative career development/life development facilitator- 
student negotiated contracts could be Invented, The basic 'activity sheet" or contract form or 
"single page learning activity package" already exists in EBCE I What an interesting direction! For- 
get evaluation in that context, but think of the Individualization, the benefits, and think of the 
added knowledge that counselors would now have and think of the tremendous amount of research 
that the evaluators v^ho don't have to evaluate can now do in terms of long-term research, cross 
comparisons, longitudinal studies==things that will "turn on" evaluators and researchers alike. 

In summary, I vvant to stress that it has been a pleasure for me to talk with you about this 
very interesting paper by Sam Osipow. I think Dr. Osipow has demonstrated that given more time, 
he can bring his comprehensive knowledge of career development theories and the studies that 
support or refute them to bear ^n experiential education with benefits to us all. His other insights 
from his vast knowledge of connseling will help us too. 
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ECONOMIC PERSPECTIVE 
ON EVALUATING THE CONSEQUENCES 
OF EXPERIENTIAL EDUCATION 

Dollari and Sense 



Nicholas M. Klefer 
University of Chicago 

This symposium is set up to explore alternative approaches to evaluating educational pro^ 
grams.* The need for evaluation is clear: agencies should not fund programs which do not "work" 
when there are alternative programs which do, Widespread public dissatisfaction with the state of 
American education, perhaps stimulated by the widely reported decline in test scores of students, is 
undoubtedly going to force more evaluation of programs and selectivity in funding of programs. 

This paper concerns educational evaluation in general and evaluation of ''experientiar' pro- 
grams in particular. These programs are diverse, ranging from the EKecutlve High School Internships 
Program in which high school students spend a few days a week working without pay at an interest- 
ing job to programs like Occupational Work Experience {0,W.E.) Training in which participants 
work during school hours at a paid, but generaliy much less glamorous job. To the extent that there 
are goals associated with these programs, and there is a presumption that there are goals of some 
sort to justify funding (surely funding agencies have not adopted "goal-free" funding), the goals are 
likely to be different, or at least differently stated. This would seem to imply different data needs 
and evaluation strategies for the different programs, I will argue below that one basic evaluation 
strategy will apply to a wide group of programs. 

This paper is primarily concerned with measurement of the effects of f jcational programs on 
participants. The subsequent translation of these Into benefits to be compared with some measure 
of costs is difficult and a number of important and different issues arise. 



I. Earnings as the Appropriate Outcome Measure 

Labor market variables, particularly earnings, are appropriate measures with which to estimate 
the effects of programs for programs with a variety of goals. This measure has been used extensively 
by economists investigating manpower training programs. A program which achieved practically any 
sensible goal could be expected to increase participants' earnings. Using the earnings to measure pro- 
gram effects avoids a number of problems associated with constructing and interpreting tests. If a 
worker has more "maturity" or "know-how" than another worker, then, other things constant, he 
will have higher earnings. The measure is not perfect; some Jobs with more pleasant characteristics 
or working conditions may pay, as a consequence, less than another job in the same occupation 
with unpleasant working conditions. Higher earnings does not necessarily correspond exactly to 
higher productivity; the point to be made here is that earnings are probably the best available meas= 
ure. Controlling for variations in job conditions could be important in the analysis. Further, not all 
participants will be affected equally. On average, however, we would expect that if an educational 
program is successful in achieving any sensible goal (perhaps not the stated goal), then the earnings 
of the participants will be higher than they would have been in the absence of the program. A key 



*l would like to thank Thomas R. Owens for useful comments without implying that he agrees 
with the views expressed in this paper. 
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issue, of course/is the appropriate way to meaiure what earnings would have been in the absence of 
the program. The Isiue is discussed in the next section. Of course this issue arises no matter which 
outcome measure is chosen. 

In addition to being more appropriate and less ambiguous than test scores as measures of pro- 
gram effectiveness, earnings are easier to measure. Readings on earnings over several (the more the 
better) periods on each individual can be used to improve the accuracy of measurement of program 
effectiveness, much like different tests could be given to reduce errors of measurement of whatever 
was being tested. To do this with tests, however, requires substantial effort on the part of the evalu= 
ator and substantial cooperation from the program participant: Measures of earnings can be made 
much more easily. Further, repeated observation on earnings can be used to assess the longevity of 
program effects— does the program reduce turnover and increase earnings in the early period of 
labor force attainment? If so, does this result in increased earnings over the career? Detailed infor- 
mation on labor-market variables could be combined with regular periodic follow=up information on 
occupation and earnings to answer these questions. The possibility and usefulness of gathering fre- 
qu€*nt observations on test scores is remote. 

Sometimes educational programs are interpreted as providing participants not only (or perhaps 
not at all) with information about the Job market or with skills, but with information about them- 
selves—that is, the program may help participants to clarify their likes and dislikes sufficiently that - 
they can make decisions with less sampling of things (jobs in this case) they dislike. While the pro- 
gram may not provide regular information about the labor market, to the extent the program is 
successful, the earnings of the participants wiil be increased over what it would have been in the 
absence of participation in the program. Surely we would expect that Individuals with better knowl= 
edge of their own likes and dislikes, and perhaps better ability to assess likes and dislikes in new 
situations, would do better in the Job market. They would be more sure of themselves and more 
reliable, and this would result In higher earnings. 

Although attention so far has been focused on programs like O.W.E, for which direct labor 
market data on participants is easily collected, the same analysis could be made on alternative 
programs. The difficulty is that so much time may intervene between the in-high-school programs 
for students who go to college and their labor force entry that the program is likely to have little if 
any effect. However, this may not be true, and sufficient detailed data, which would allow control 
for intervening events, could be used to measure the effect of these programs. Note that some pro- 
grams may affect future earnings through their effect on decisions about schooling, choice of 
college major and so on. This corresponds directly to the effect of O.W.E. on earnings through its 
effect on occupational choice. Earnings are still the appropriate outcome measure. To the extent 
that the programs have any effect in training participants to make better decisions and plans, or to 
be more mature, these will be reflected in higher earnings. Employers will value these abilities, and 
will be willing to pay for them. Consequently we would expect participants in a successful educa- 
tional program to have higher earnings than they would have had without participating. Of course 
this need not be true for each individual participant, due to variations in program effect and un- 
observed variations in job conditions, but it will hold for the average. 

In general, then, we can expect that participants in successful educational programs will have 
higher earnings than they would have, had they not participated in the programs. This holds for pro- 
grams with a variety of stated goals. (What plausible goals of an educational program would not lead 
to higher earnings?) Measurement of earnings is easier than measurement'of "know-how,'' and re^ 
peated measurements can be made in order to increase the accuracy of measurement of program 
effects and to ask more detailed questions about how programs work. 

IL Evaluation Strategy and Data Requirements 
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program and control groups and not be told that the experiment was taking place or which group 
each was. in. Their subiequent earnings could be used to estimate program efficts by looking at 
earnings differencei over time between participants and nonparticipants. This would be an appro- 
priate measure of the effect of the program becauie the only systematic difference between partici- 
pants and controls Is that one group was in the program and the other group was not. This basic 
strategy applies whatever outcome measure is used. 

Certain obstacles stand in the way of operating educational programs this way, Identical sub- 
jects are not available, participants generally know whether they are in a program, and assignment 
into programs is, while arguably haphazard, not random. Program managers typically object to run- 
ning programs as experiments for the convenience of evaluators, preferring to run the program wlth-^ 
out knowing their effects. This is not an entirely unreasonable position, if the programs have effects 
then a random assignment to the program is not likely to be an efficient allocation of resources. 

The implication of the non-experimental setting for analyzing the program's effectiveness is that 
preprogram differencfs bt^tween participants and nonparticipants need to be controlled for carefully. 
Thf possibility of confusing program effectiveness with the effects of preprogram differences in capa- 
bilities between participants and nonparticipants arises. Again, this problem arises whenever.non 
random assignment is used, whatever outcome measure is chosen. In order to try to control statistically 
for preprogram differences jDetween participants and nonparticipants, as much information as possible 
should be assembled on individual characteristics. It may then be possible to model selection into the 
program in such a way as to reduce the possibility of confusing program effects with other effects. 

As to labor market information, certainly information on wage rates, occupations, and fre- 
quency and duration of spells of unemployment should be assembled. Data should be gathered also 
on workers entering the same labor market who did not participate in the program. The starting 
wage at thfe first job is not itself enough information, follow-up information is necessary. The re- 
quired data could be assembled by having high school students fill out questionnaires and then sur- 
veying them regularly during the post program period. Survey intervals and techniques could be 
selected on the basis of cost versus accuracy, as usual. Detailed information on job characteristici 
could be used, to standardize earnings measures for variations in working conditions. 

Using these data cross^program comparisons can be made by examining program effects as a 
function of program characteristics. Ideally those program characteristics leading to favorable out- 
comes can be identified and their use can be expanded; those leading to unfavorable outcomes can 
be reduced. While it is extremely unlikely that "optimal" programs will result from this strategy, 
it seems likely that some improvement can be made. 

III. Conclusion 

The evaluation strategy suggested here is to compare earnings of program participants and non- 
participants. This strategy has been useful to economists evaluating various manpower training pro- 
grams. The basic idea underlying this strategy is that programs which have any beneficial effects, 
whatever the stated goals, will result in participants' earnings being higher than they would have 
been without training. 

It is interesting to compare this approach with the "goal-free" approach. In the goal-free ap^ 
proach, stated goals of a program are ignored and the evaluator hunts around looking for all effects 
of the program, The motivation for this approach is that programs may fail to accomplish a specific 
goal but may have beneficial effects other than on the stated goal. An evaluation which concentrat- 
ed attention on the specific stated goal may fail to notice the other effects of the program; in princi- 
pal a goal-free evaluation would find these other effects. The difficulty associated with goal free evalu- 
ation is that there are a lot of potential effects to look for and no evaluation can hope to examine a 
program for all possible effects. However, earnings comparisons provide a convenient natural method 
of examining the effects of a program. Whatever positive effects a program has are likely to be reflected 
in. earn in as i ncreases. F a rninn^ Hlffpr^nrp^ nrnuiHp mgaeitrpe rf nat nrz-tfirofyi offai-^tUmr^ft^p n\..,^.^ »k^* 
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Looking at income as the most Important 
variable preitnti a rather narrow scope. With the long 
time lag between programs and wage information, the 
wage increase Is less attributable to program success. 

There are other variables that could be included; 
for example, assesiing those things which contribute 
to higher wages, as opposed to looking at higher 
wages as an indicator of program success. One com- 
ment that bears mentioning is the fact that experiential programs exist which have nothing to do 
with getting a Job. For example, there are programs that deal with becoming a better citizen or 
contibuting to society in a different way. 
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The group related this idea of a single measure 
to Dr, Osipow's point that one might use earnings as 
the outcome variable of interest for those program 
participants who have as a major goal Increasing their 
earnings. This would be one way of matching an out- 
come measure with particular individuals. However, 
evaluations of the Neighborhood Youth Corps and 
Job Corps do not give cause for optimism about the 
ease of doing that kind of evaluation or of the power 
of the program to have an economic effect. The group questions several of Dr. Klefer's assumptions. 
If Paul Barton were here, he might raise the question, for example, that Job mobility of seventeen 
to twenty^one year olds is a result not of their conscious choice and search for Information, but 
rather employer prejudice against hiring people under the age of tA/enty-one. There is also the 
possibility that a settling-down process takes place after twenty-one, and that people stop chang- 
ing jobs so often because it is hot practical. They are married; they have economic commitments; 
they don't have the freedom that they had earlier. It would be interesting to know whether those 
people who have moved from Job to Job in that period wind up in jobs which provide more satis- 
faction and higher earnings than those who do not go through that job'Shoppihg process. 
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Many employeri do value the kinds of things that 
schools are trying to achieve, which we saw as Dr. 
Kiefer's basic argument. The group recognized the 
practical arguments about the convenience of the 
economic measure verwjs others, however, it was felt 
that it's just not that simple to pull off. Noted also was 
that if a school system Is under the gun for accounta- 
bility to the community, earnings have an appeal that 
might carry the day when it is time for voting on tax 
reform. One assumes that education increases the competence of an individual to perform^ and that 
this is valued by employers. On the other hand, some say that the effecti of schooling are not to 
increase competence, but to provide a certifying effect. If that Is the true effect, then the whole 
argument will fall flat. One assumes that the graduates of these programi will seek to maximize the 
earning potential they gain from the program. If they opt for alternative work styles, for Job shar- 
ing, for situations in which money is not the attraction, the correlation will not hold, The gruup 
also observed that if an evaluation of a particular program Is conducted in this manner and shows 
no effect, the evaluator will be unable to say whether it was the hypothesis or its implementation 
which was faulty. 
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The presentation was taken as a definite sugges- 
tion to get our house in order by being able to use 
cost-benefit analysis. The group would also like to 
use job satisfaction, knowledge, and skill transfer- 
ability when measuring some of these things. One of 
the most valuable selling points for experiential learn- 
ing is that it can decrease the job-shopping situation. 
On the other hand, developing options for students 
may increase their mobility both horizontally and 
vertically, and it is not known whether that increases job-shopping. Nevertheless, elirninating job- 
shopping would decreasL the personal costs, employer costs, and the cost to society since it would 
remove the need for unemployment compensation and welfare among program participants. Who 
is going to fund this massive analysis— program developers, employers, HEW? Going back to the 
Keynote Address, socioeconomic background creates more chances for a student than anything 
that can be done In experiential learning. Two surveys of employers were done recently In Texas 
and Ohio and each came back saying the same thing you were saying about seifconcept. Those 
individuals who are most employable and have the most job satisfaction are those who have a 
strong work ethic. Skill level does not always make a good employee. Finally, the group felt that 
income finds its worth as a categorization tool rather than as an evaluation tool. The group believes 
a primary goal of experiential education is to motivate individuals to learn, with wages as a secon- 
dary goal. 
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When I found out yeiterday that I was going to be here today, and that I was going to be on 
at 4:30, I realized that I should be either very good or very brief. I think lil try to be very brief 
rather than very good, What I think Nick has raised here today is that there is a vei7 simple, 
straightfonA/ard, rational approach at looking at experiential education programs. That is simply 
comparing eamingi between participants and nonparticipants, Now this approach Is one of perhaps 
many that could be tried and although It may seem very simple as some people have suggested here 
today, it may well be more complex than we really know. We have tried this approach In other 
cases and In other programs and It has proved difficult Some people consider this approach tq be - 
somewhat narrow in scope and focus, This is probably ymy true, but at some point In time you have 
to delimit your area of inquiry. Nonetheless, I suspect thst the participants here at this conference 
would like to look at other variables and Tm sure Nick would like to discuss them with you later. 
Thank you. 
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Cultures within Cultures 

Shiila S. Walker 
University of California, Berkeley 

Thinking up alternative methodi for evaluating educational phenomena in the Midwest of the 
United States sounds rather out of character for an anthropologist, whom one might more common- 
ly expect to find examining the ceremonial practices of an exotic group of people living In a remote 
and faraway place of which few have heard. In addition to the fact that the anthropologist seems 
out of place in an American clasiroom, the style and methods of anthropological research are 
diametrically opposed to those of the traditional educational evaluator of the pritest-posttest 
variety. Sojourning for extended periods of time with unfamiliar people In unfamiliar environments, 
learning the language, seeklhg to undirstand different kinship terminologies and behaviors, un- 
tangling complicated social structures and systems of authority, observing the ways In which the 
ecology shapes the culture, and trying to perceive the logic and meanings of a totally new belief 
system and worldvlew are the stuff of anthropology. In fact, the eKtended fieldwork experience 
in some exotic place has traditionally teen the rite of passage that has transformed a student of 
anthropology into a true anthropologist 

So, what are anthropologists doing looking at something as low on the exoticism scale as an 
American school system? Even In its more novel elements, such m the non-traditional (even some- 
times anti^tradltional) experiential education programs, American education hardly seems to com^ 
pare with Tiwi puberty rites, for example. But then maybe It does through the eyes of an anthro^ 
pologlst 

Trained to learn to understand unfamiliar cultures by Peking to distinguish and analyze their 
constituent elements they can use their tools and theories to do the same thing in a more familiar 
culture, even their own^ The basic premise of anthropology Is cultural relativism, according to 
which all societies, from the most technologically simple hunters and gatherers, to the most tech^ 
nologically complicated post-industrial societies, involve the same basic functions and institutions. 
There is always a linguistic system able to express complicated concepts, a social structure that 
categoriies individuaii Into groups and prescribes and proscribes certain behaviors and attitudes 
vis-a-vis different social categories, a political system that regulates social behavior, a scientific and 
technological system by means of which humans figure out and adapt nature to their needs as they 
define them, a system of beliefs about the natural and supernatural worlds and their interrelation- 
ships, and a system of socialization/education that shapes children to become proper members of 
the society. As a result of studying other societies, anthropologists acquire a novel perspective thai 
can enable them to analyze their own society as If they were discovering it for the first time. Thus 
they should be able to s^'je the commonplace as well as the unusual event In a familiar setting as a 
result of learning to see both in an unfamiliar setting. 
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Horace Miner's very astute article entitled, "Body Ritual Among the Nacirema'' {1956), ii a 
prime example of the ahthropologlit's ability to describe a very familiar society in the same terms 
as he/she wou.a any other exotic society, since exoticism or familiarity Is basically a matter of 
perspective and style of description. Naclrema body rituals include paying daily homage to a sacred 
shrine, a private one of which Is located in each family dwelling. At this shrine the males of the 
society scrape the hair off their faces with sharpened bits of metal, the females paint their faces 
several colors, and both sexes put bundles of pig hairs in their mouth in order to assure their sex 
appeaL Periodically the Nacirema visit the more sacred shrines of the holy mouth men who bore 
holes in their teeth with sharp pieces of metal and introduce unknown substances with magical 
powers into the holes. The Nacirema, who live between Mexico and Canada, have numerous other 
bizarre sounding customs. 

Irr recent years many anthropologists have begun to study close to home phenomena with the 
same perspectives they use on foreign societies, even making comparisons between the two. In fact, 
in the early days of American anthropology, one reason for studying smaller, unfamiliar societies 
was to see how they dealt with certain social issues also facing Western societies to offer alternate 
possibilities for the latter. With respect to education in the United States anthropologists have taken 
two basic approaches, using them alone or In tandem. The first approach is to apply the kinds of 
theories and perspectives gained from learning about socialization/education in other societies to 
similar phenomena In the United States, using understandings from the former to better see and 
analyze the latter. The other approach has been to actually do observational field research in edu- 
cational settings, treating the school as a small socio-cultural system containing the same kinds 
of institutions found in the larger community while at the same time being a very important Insti- 
tucidn of this larger society. 7 his latter approach has proven very useful for understanding aspects 
of school behavior not accessible through standardized tests or statistical survey methods, but only 
through direct observation and interaction with the actors. While this research method is perfectly 
valid for the analysis of traditional educational institutions. It seems especially appropriate to use 
such a still non-traditional research style to analyze and evaluate the kinds of non-tradftional edu- 
cational institutions represented by the myriad experiential education programs spread across 
this country. Since these programs are, by definition, designed to accomplish different ends than 
the traditional educational system, and to pursue their goals through different techniques, one 
might reasonably expect the methods developed to evaluate the outcomes of traditional education 
to be maladapted to these alternative programs. 

It is appropriate at this juncture to ask exactly what an anthropologist might do if requested 
to evaluate an experiential educational program. I will give you an idea of what I did when our poly- 
disciplinary team visited two experiential education programs in the Columbus, Ohio area selected 
for us by the ftaff of the National Center for Research in Vocational Education, The purpose of 
the visit to the two well-selected sites, as well as a subsequent opportunity to meet with people 
from differbnt types of experiential education programs from all over the country, was to give us 
a common basis for suggesting new methods for evaluating such innovative programs from our 
respective disciplinary perspectives. The staff of the National Center told us very little about the 
programs, wanting to allow us to discover them for ourselves. They indicated, however, that they 
and others involved with these alternative programs felt that they were producing positive results, 
but that the traditional paper and pencil pretests and posttests used in educational evaluation had 
proven unable to docunnent these results. Consequently, new methods were in order that were 
better adapted to understanding the outcomes and dynamics of these programs, 
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Short of going to an eKOtic place, this opportunity could pass for an anthropologiit's dream— . 
the opportunity to go into an unknown subculture/quite unfamiliar In its specifics even though 
part of a common larger culture, with the assignment to just "see what's going on/' Such an oppor- 
tunity to just observe the ''native culture" with neither any preliminary seeking of data about it 
norefforts to examine a theoretical question that it just might exemplify is rare in this era of tightly 
structured and even more tightly scrutinized research proposals. Thus, I embarked upon this ad= 
venture as much as if it were a trip to a remote South Sea Island as was reasonable, given that it 
really was Ohio. = 

I must preface any illustrations of methodology drawn on the two sites visited, which I will 
call White Collar School and Blue Collar School, by saying that our visits to them were each made 
in half a day. Consequently any observations were of necessity incomplete and superficial, as well 
as not entirely comparable for the two programs. We naturally observed and were told more about 
some aspects of each program than of the other, the aspects focused upon in each perhaps reflect^ 
ing their own emphases, or perhaps reflecting more a momentary concern on the part of progrdm 
participants as a result of recent events, or maybe a special interest on the part of the researcher. 
The only way in which the researcher can get a sense of enduring, as opposed to temporary, con- 
cerns and emphases in the program is to spend more time observing regular patterns In the pro- 
gram and interacting with participants. 

This fact points up a very important methodological Issue with respect to using anthropologic 
cal techniques for evaluating educational programs. The ideal length of time for doing field research 
in an exotic culture is eighteen months. The first six months are for gaining entree to the society, 
acquiring a familiarity with the language, getting a general idea of the social structure and generally 
settling in and learning the ropes. During the next twelve months the anthropologist can observe 
the entire yearly cycle of llfe-the day to day routine, the changes in activity due to seasonal 
changes, and the special annual ceremonial events. 

It would be a bit exaggerated to expect an evaluator to spend a full yearly cycle observing 
an experiential program since much of the activity is very familiar to one who has gone through 
American schools, although were the intent to do a complete ethnographic analysis it might not be 
too long. However, in order to have a sense of what actually happens during the year to produce 
whatever outcomes are obtained, it would be idial for him/her to spend perhaps the first and 
last two weeks of the year observing student behavior In both their In-school and on-the-job set- 
tings, and in talking with students, faculty and work supervisors, in order to get a sense of the 
changes the program has made in the students. In addition to focusing on outcomes/ the researcher 
should spend at least two full weeks in the middle of the year observing the program and talking to 
the participants in order to get a sense of the regular functioning of its various components. The 
researcher should also be present at significant events. For example the weekly town meetings in 
which all members of White Collar School discuss and propose new activities, changes, etc. in their 
program is clearly an important event for understanding school dynamics. 

Before beginning to be able to think of evaluating these programs, an anthropologist would 
try to gain as broad an understanding of the program as a whole as possible, focusing on the same 
elements on which one would focus in any soclety-the social structure, the cultural values, the 
linguistic system, etc. One might begin by using the kinds of unobtrusive measures employed by 
archaeologists who cannot interact with members of the societies they study, so they must try to 
understand them by observing the physical setting and the cultural artifacts. The physical settings 
of the two prdgrams observed immediately hinted at fundamental differences in the programs. 
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Both programs are high school programs involving In-school academic training plus ^n out= 
of-school work experience (usual but not absolutely required in White Collar School) as part of 
the normal school program. White Collar School is located in a visibly affluent suburb of Columbus, 
There are tree rmed streets, large, attractive houses and welUtended lawns. White Collar School is an 
alternative program that is part of the traditional high school in the town. It Is located a distance 
from the traditional school in a house that immediately suggests the adjective "funky." Upon 
entering the building one is struck with a sense of relaxed disordor that suggests a creative, do your 
own thing type environment. Walls are painted odd colors and one sees remnants from artistic proj- 
ects. Studtnts seem to move around the building freely. The rooms seem to be multi-functional, 
and a very large room with a stage appears to be not only a performance area but also the locus of 
small and large group meetings. 

There are large, brightly colored posters on the walls, particularly in the friendly and informal 
administrative office, with sayings such as "Following the Crowd Can Lead Nowhere/' "Behold 
the Turtle Who Makes Progress Only When He Sticks His Neck Out/' The fact that these particul&r 
posters were selected suggests a certain cultural orientation with an emphasis on individualism and 
personal risk-taking and responsibility. Other posters with what might be interpreted as an ego^ 
supporting theme said "To Know You Is to Love You'* and "Today Many Beautiful Things Will 
Happen to You." 

Blue Collar School Is in a very different kind of suburb of Columbus in which small frame 
houses seem randomly placed on mostly untended lots. The office of the alternative program is down 
a long corridor in a wing of a very institutional looking red brick building. Although we did not see 
the classrooms, I would conjecture that they are the standard oblong eye^ease green rooms with 
desks In rows with which those of us who went to public school before someone came up with the 
great idea of alternatives to them are all too familiar. The halls are empty of students. Film can- 
nisters lying on a desk display very inspirational titles, but a coordinator later says that they ar^e 
entirely inappropriate to the program since they present unrealistic role models, like the Kennedys, 
to children of welfare and unemployment compensation parents. The regular students are in class; 
those in the alternative program are on their jobs. Thus the physical settings in which the two 
programs are located and visible cultural artifacts already suggest to the anthropologist programs 
with different world views that will be peopled and structured very differently. 

Having unobtrusively gotten general impressions of the soclo^physical ecological niche in 
which the program is situated, the anthropologist then seeks to know more about the formal struc^ 
ture and cultural values of this mlnhsociety; who are the students and why are they there, when and 
why and by whom was the school founded, what is the composition and hierarchy of faculty and 
staff, what is the nature and schedule of currlcular and extra currlcujar events, what is the relation^ 
ship between the alternative program and the regular school program, what is the school com- 
munity's selfnmage, what do administrators, faculty and students like/not like about the program? 

Some of these answers may be gotten through reading the formal documents of the institutions 
and very importantly through talking to people in different roles. Inspection of written records 
and both formal ^ind informal interviewing are essential components of an anthropological ap^ 
proach, supplementing the researcher's observations of behavior. Written statements of purpose 
give a vision of the philosophical Ideals as well as the ideal structure, functioning and intent; Other 
written statements, such as student publications, posted schedules and announcements, forms to to 
filled in, and memoranda can provide an idea of the actual workings of the mechanism. Memoranda 
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can be particularly useful in giving a sense of what actually goes on, significant or repeated events, 
day to day concerns, and often elements of the program or aspects of behavior that might be Im- 
proved. Any kinds of assessment reports of student performance done by faculty members or work 
coordinators would provide very useful data, If accessible to the researcher-evaluator, as would be 
any written comments by students concerning their work placements. For example, In White Collar 
School the students draw up contracts with their faculty advisors indicating the courses they will 
take, and describing their work experience. These contracts are signed by the student, his/her 
faculty advisor and his/her parents, who are thus also involved in the process. Posted notices reflect 
the fact that students may suggest new courses by posting descriptions to ascertain the degree of 
interest in their idea. In addition, administration, faculty and students at White Collar School have 
collaborated in writing up a self-evaluation. It is a perceptive document that points up both poii^ 
tive and negative elements of the program as viewed from the different perspectives of the partici- 
pants. It reviews the goals of the various categories of participants, and the changes In these goals as 
the program evolved and faced day to day realities as well as the processes set up to implement them and 
the changes that were made or should be made in these processes for a more satisfactory program. 

The documentation to which we were exposed at Blue Collar Bchoorconsisted of a very detailed 
program description setting out the goals, rationales and specific objectives of the program. This docu- 
ment would provide the researcher with a very clear outline of the program. While such a document 
could guide the researcher-evaluator in examining the process of the program and the intended out- 
comes, it should not limit his/her sphere of observation and inquiry, since actual process and outcomes 
often differ from the intended. Even if they coincide, however, it Is Important to ascertain the process 
through which the intended outcomes are implemented in order to evaluate effectiveness. In addition, 
surely the intended outcomes do not exhaust the effects that participation in the program has on the 
students, and these unplanned outcomes should also be noted in an evaluation. 

The essence of the anthropological method is its multi-faceted approach, manifest in the 
tendency to look at the same issue from different perspectives and to gather Information via dif- 
ferent modes. Thus, in addition to the relatively unobtrusive methods mentioned earlier of pure 
observation of the setting and of cultural artifacts and of reading documents, observation of social 
interaction, both formal interviewing and more Informal talking with people, as well as Just hanging 
around and getting the feel of life in the society are major elements of an anthropological approach. 
In looking at the externalities of these programs the researcher begins to draw certain inferences. 
Reading printed documents-from posters to program descriptions— adds further data that may sup- 
port initial impressions or lead the researcher to develop new Impressions. Participant-observation 
research, because the researcher Is constantly surrounded by the data out of which his/her 
hypotheses grow, involves a constant process of hypothesis development and modification as the 
researcher learns more and more and re-evaluates previous, more partial, understandings, The re- 
searcher's goal is ideally to learn to understand the society as its members understand It, and to be 
able to describe it In a way recognizable to them, even if his/her Interpretation of certain aspects of 
it differs from that of some members because of differences in perspective. Consequently, talking 
with the members of the society is the single activity that consumes most of anthropologists' re- 
search time. 

In order to get a real sense of society it is important to understand the role structure and to 
try to talk to people in different roles to understand how people in different stntu^s experience 
and perceive their society, In the alternative programs visited the major role categories were 
faculty/administrators- the two roles usually overlapping, students, and work experience coordina- 
tors. To understand the prngrams well, it is essential to talk to as many people as possible in each 
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catigory,,and to talk with them when no members of the other categories are present, as well as is 
conjunction with members of other catigorlei, It is easy to understand that students might not [jc 
totally candid in expreising any non-poiitlve feelings they may have about a program in the 
presence of the person or people who judge them. 

in White Collar School we had the opportunity to talk with students alone, in small groups and 
in a formal group with the chief administrator of the program. On the basis of these conversations 
I had the impression of a shared community of attitudes between students and faculty/administra- 
tors, and a definite candor in discussing what was good and bad about the alternative school, their 
reasons for being there, what they had hoped to get out of it, what they were getting out of It, 
and what, if anything, was missing and why, One student even took me to visit his work site, a tele- 
vision station, The students who chose to talk about the program were those who thought very 
highly of it, and who felt that it had had a very beneficial effect on many aspects of their lives. It 
would have been interesting, for a sense of balance, to have talked with students who did not like 
the alternative school and who planned to return or had returned to the traditional school. It also 
would have been good to talk to faculty members alone, and to talk to parents about the 
differences being in the alternative school had made for their children. However, although the con- 
tact was quite brief, and a researcher can hardly expect people to tell al! r ^ Initial encounter, I 
had the impression that, given the ambience of freedom and candor reign ' '^e Coller School, 

the people I talked with did give me an honest picture of the program. 

In Blue Collar School students were out on their work assignment when we arrived so we first 
talked with a faculty member who then accompanied us to one work site to talk with a student, 
who never showed up, and his work experience supervisor, who had been working with the program 
for years and expounded on its benefits for the students from his perspective. We went to a second 
work site and talked with two students in the company of the faculty member and the work super- 
visor, a rather stilted situation. The students mainly expressed their pleasure about the benefits 
of the program in brief responses to direct questions and the faculty member and work supervisor 
assured us of the great benefits of the program for these two model students, 

Although this was an expedient way, given the structure of the program, to allow members 
of our team to encounter program participants of all categories and to see the students In their work 
site, the immediate anthropological reaction to such a scenario tends to be the impression that the 
researcher is being presented, with an ideal image of the subculture in question. Having seen the 
ideal, the anthropologist wants to know how the day-to-day reality corresponds to this ideal 
picture and becomes even more curious to observe the functioning of the in-school part of the pro^ 
gram, and to talk to the members of each role status, especially the students, separately. In talking 
with the members of the three role categories together I had the impression that the script of the 
conversation followed the program description very well. It Is quite possible that this Is precisely 
the case since the program Is very highly structured with very specific objectives. Perhaps the real 
(tieaning of our encounter was that the program is functioning exactly as intended, 

In any case, whether or not the Ideal and the real correspond exactly or not, it would be in^ 
structive to observe the process by which efforts to arrive at the goals are implemented. It would 
also be good to talk with students who would like to leave or have left the program because of their 
dissatisfaction, In contrast to the candid and very verbal style of White Collar School students, 
Blue Collar School students appeared more reserved and less apt to comment at length about it. 
Perhaps more elaborated responses would be possible in a less stilted setting, and perhaps a 
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researcher ivaluator wou !d have to spend more time ^coming a familiar member of the environ- 
ment a situation usuihv anticipated in doing participant-obsirvation rtsiarch. The riSilrcher must 
take into consideration the fact that hii/her own personal characteristici-ginder, age, appearance, 
status, etc-will influence responiei, and try to evaluate the results of this factor, In addition, the' 
researcher must realize that if he/she associates more with one category of people than another, 
for reasons of receptivities of common personal interests, he/she may be seen by the others as shar- 
ing or representing the interests of that category and reacted to accordingly, 

In using formal and Informal interview material as data it is, of course, necessary to try to 
weigh the meaning and veracity of people's statements. Certain guidelines are useful In this en- 
deavor. The researcher will often find that if he/ihe talks to people in the formal context of the 
research in question, the respondents will give formal, "party line" responses, whereas in a less 
structured setting the same person will give more natural responses that more closely approximate 
his/her own real reactions, attitudes, etc. It is good to compare answers gotten from people in a 
group setting to those given by the same individuals when they are alone to get a sense of gruup 
attitudes as compared to those of the individuals composing It, which may or may not actually 
coincide because of individual circumstances. 

The researcher will undoubtedly find that some people are more anxious to talk to him/her 
than others, and should seek to find out why In order to judge tne information he/she provides, Is 
the person just open and/or loquacious, does he/she have an axe to grind, is he/she trying to en^ 
hance the portrayal of his/her status by the researcher, is he/she a self-appointed spokesperson 
determined to create a certain image of his/her subculture, or is the person someone who happens 
to be particularly Interested In and informed about this subculture and considered knowledgeable 
by his/her peers? To decide which Is the case the researcher must talk to many people, weighing 
their responses on the same issue against each other, taking their role-determinod perspectives into 
account, and comparing data gathered In different ways about different aspects of the socio- 
cultural system, to test for consistency or inconsistency. Finding Inconsistencies, the anthropologist 
should seek to detect their origins and meanings-to see if they represent problems In data gathering 
or interpreting or if they rather represent contradictions in the socio-cultural system that must be 
accounted for. Consistencies In data gathered from different sources should suggest that the anthro- 
pologist is getting an accurate image of the socio-cultural system, 

Also it is reasonable to expect that as the researcher-evaluator gets to know the subjects of his/ 
her research better and thfey him/her, their rapport, assuming It is positive, will become more 
candid. The researcher must also remember, however, that social groupings have secrets, myths, 
contradictions about which they are not proud, and what Wilson (1977) refers to as "sacred cows," 
aspects of belief or behavior that are not readily open to discussion or c|ange. When touching on 
such items the researcher may expect avoidance of issues, polite non'respohses, defensiveness, 
hostility and the like when touching upon sensitive issues. Such reactions should suggest to the re- 
searcher that he/she has touched upon an issue that, since so sensitive, must be of some importance, 
Circumspection and indirection are required of the researcher who seeks to understand more with- 
out offending or alienating his/her sources of information. Particularly when doing an evaluation 
the researcher should be conscious of the fact that people may be hesitant to share information 
with him/her for fear of possible repercussions for the program or for the individual, particularly 
if this information is not totally complimentary. The researcher-evaluator must also be conscien^ 
tious and responsible in handling information that is sensitive, shared in strictest confidence, or 
potentially damaging to the program or individuals. It is not essential to tell all in order to present 
an accurate and scientifically valid portrayal or evaluation of a socio-culturai system, A sense of 
social ethics must accompany one's sense of scientific duty. 
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The White Collar School and the Blue Collar School have very different dynamics. The former 
has a very relaxed, creative, non-traditional style in which faculty and students participate in the 
deciiion-making process and faculty as well as students feel that they are in school to learn. The un= 
paid work experiences for these children of professional parents allow them to explore possibly 
interesting, more professional career options. The students see themselves as more 'individualistic 
and adventuresome than the students in the traditional school they chose to leave, some because 
they did not feel that they fit. 

The Blue Collar School program, in contrast, is highly structured, and the relationship between 
students and both their faculty and advisors and their work coordinators is strictly hierarchical and 
authoritarian. The low income students in the program were/are potential high school dropouts 
who, however, were or have become aware of the value a high school diploma can have in their 
futures. The purpose of the program !s essentially to provide them with the basic personal skills 
ond knowledge necessary to be able to get and hold an unskilled job and make them eligible for a 
paycheck rather than a public assistance check. Thus the structure and intent of each program is in 
harmony with its sociological setting. The general nature and style of each program might have 
been predicted from the initial unobtrusive observations of its socio^physical ecological niche. 

This apparent diametric opposition totween the two programs with respect to physical con- 
text, sociological characteristics, structural qualities, and purpose of the work experience, belies, 
however, very fundamental commonalities that were also found in the other high school experieri^ 
tia! education programs from which we met with representatives.* These commonalities were dis-\ 
covered as a result of what was of necessity a rather superficial linguistic content analysis of the \ 
comments of participants in all of the experiential programs— whether they represented opportuni^ 
ties to explore career options for the affluent or last chances to acquire minimal skills for the less 
advantaged. In all of the piograms the students said that what they acquired as a result of their 
work experience, paid or unpaid, was a "sense of responsibility." They learned to "take charge of 
ftheir] own lives." They "felt more mature." They considered their work 'project to be a signifi^ 
cant experience that taught them about "the real world," they learned about "life." Frankly, I was 
quite surprised to hear participants from all of the programs, wherever they fit on the socio= 
economic scale, using exactly the same language, exactly the same terms in talking about what they 
had gotten out of the program. 

As an aside, before elaborating on the implication of this striking linguistic characteristic, it 
was interesting to note that the great majority of the programs with which we had contact clustered 
at the top and bottom of the socioeconomic scale. They were directed toward either providing basic 
skills for potential or former high school dropouts that would perhaps allow them to work in a box 
factory or a dime store, or toward allowing students from schools in affluent areas to discover 
through practical experience the kind of professional career they might like most— at television 
stations, as business executives, and the like. There were few programs represented that were directed 
toward allowing average kids from average families to explore the world of work^ perhaps precisely 
because of the very averageness of such an idea, Programs like Blue Collar School allow adoles^ 
cents with few options in life to develop their potentials for being employable on a regular basis as 



*Two postsncondciry programs wore ro[jre$ented that involvocl work oxperionces witliin an 
ticademic context, but other than this basic characteristic, they had nothinq in common with oiich 
ottier and not enough in cnrTimon with the high school programs that aro of primnry concorfi finre 
to have a niaco in this analysis. In this context, they were interostinf) anomnlins. 
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well as giving them ixposurt to aspects of life and a style of life for which their home environments 
could not prepare them. Programs like White Collar School allow young people who have the 
possibility of having many career options to discover what they are, and which onei may suit them 
best thus allowing them to best actualize their potentiaL 

Such polar differences In the kinds of experiential education programs that are most prevalent 
make the linguistic iimilarities their participants exhibit all the more striking and suggest that this 
linguistic feature may provide a key to evaluating the effectiveness of the various programs and the 
real nature of their effects on the students. Initially, the language the students use about their pro- 
grams sounds as if they have all memorized the same script, which was clearly not the case. Nor 
had they acquired the same terminologies through association or cultural diffusion, Rather It 
appears, on the basis of what is admittedly nowhere near an exhaustive investigation, that although 
the styles, structures and methods of the various program^ are very different In conformity with | 
their different socioeconomic milieus and exigencies, their basic cultural values are quite similar. 
Initially the similarity of the language usage makes one wonder if the students have Just learned 
the Jargon of their program goals or the jargon of the school community well, The Important Issue 
for investigation Is thus whether the students have Just learned appropriate-sounding key words to 
use in talking about the effects of the program on them or if they have actually internaliied In their 
behavior and attitudes the meanings that such words imply. How does a student in White Collar 
School or in Blue Collar School manifest to himself/herself or to others his ''sense of responsibility'' 
or Increased "maturity?'' What specifically does he/she know about "life" and "the real world" 
that he/she did not know before, how did he/she acquire this knowledge in school or on the job, 
and precisely how has he/she begun to "take charge of his/her life?" These words express the out- 
comes that the linguistic evidence suggests to be uppermost in the students' minds, Since a princi^ 
pal characteristic of the anthropological research method is to try to understand a soclo-cultural 
system as its members would, it is important to try to elicit the students' perspectives on these 
issues, ideally as the result of open-ended questions and free diicussion— combined with the com- 
ments of significant others qualified to comment, and with the researcher's observations of this 
change process from the beginning of the program to the end. Thus, without entering into the 
specifics of any of the programs, an obvious area of evaluation, empirically suggisted by even the 
briefest association with them, Is to investigate to what extent the behavior approximates the 
language and how this came to be, 

These experiential education programs, like most educational efforts, are concerned with 
something greater than Just teaching specific skills. They are also concerned with socializing the 
Individuals participating in them to be certain kinds of people. In the two programs obsen/ed, as 
well as In most of the others from which we talked to representatives, the purpose of the programs, 
in addition to providing students with experience working in the real worjd, was to build their 
self^mage and self confidence, and to give them a sense of responsibility and maturity as well as 
realistic knowledge about the world of work awaiting them. The programs were designed to effuct 
behavioral, cognitive and affective changei in the students as a result of their work oxpericncG, 
the style and content of the In school curriculum, and the nature of the social Interaction between 
students and both the faculty and the work-experience supervisors, the partlclpantobservation 
rGsearch method is particularly appropriate for evaluating both whether such changes do take place, 
and equally importantly, the precise nature of the process through whicli they take place, - 

Tfiis omphnsis on the process of change is perhaps tho most importnnt unique contribution 
of the participant observation method to the field of educational evaluation. Its significance lies In 
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the fact that this method allows the researcher^evaluator to ascertain which elements in the program 
are particularly functional in promoting positive change, which may be dysfunctional, and which 
may have little or no impact. This aspect of this process-oriented approach to evaluation is par- 
ticularly important if the purpose of the evaluation is not only to judge the program but also to 
provide feedback for improving its continued functioning, and perhaps suggesting a model to be 
replicated in other programs. Such data on the dynamics of the program cannot be gotten at 
through the pretest^posttest evaluation style that is oriented toward measuring outcomes rather 
than the processes leading to these outcomes. The anthropological approach allows both for the 
evaluating of outconnes, and for the understanding of the process. By its focus on the actual, as 
opposed to the ideal, structure and functioning of the program, this method allows the researcher 
to assess what actually happened, what factors, events, structures, and values in the program 
actually made a difference, and perhaps which ones were lacking what might make a difference * Is 
it the fact of actuaHy working in the real world, for pay or not, of feeling like an adult, or is it the 
more individualized attention, encouragement, and instruction received by students in most of the 
programs, is it the "relevant" nature of the academic content of the program, or is it the relation- 
ship between the structure of the program and the social context in which it is located that makes 
the difference? Such answers are crucial to the evaluation of such a program, and can best be 
gotten at by using a research method involving the various components of an anthropological 
approach. 
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_^ _ _^ _ _l The group likes the idea of the anthropological 

method. It is eKtremely usaful to conceptualizeri as 
a method of getting inside a program for a feeling of 
EXPERiiNTiAL the thickness of it, the dynamics that often do not 

EDUCATOR— ^ appear in tables of data and conventional evaluation 

CONCEPTUALIZER designs. Triangulation of interview data is a useful 

technique because it will usually yield a discrepancy 
I analysis of what people intended to happen, what 

they think is happening, and what is really going on. 
However, this is often negatrve and therefore sometimes politically dangerous. Consideration of 
these dangers is recommended. The alternatives of being rigid or exploring are interesting to con- 
sider. One person's rigidity is another's ssnse of structure. One person's exploration represents 
chaotic messing-around to another. It may be that the blue collar programs help lay the ground- 
work for upward mobility later through establishing good work habits now. Running a tight ship 
is not necessarily synonymous with being a Simon Legree who allows no freedom. 



It is a fascinating field. The basic strategy of 
how to observe without bias as anthropologists do 
is one that would be very difficult to implement. 
There are many examples of individuals who have 
tried to implement this strategy in their programs 
and they have had a difficult time. However, our 
group thought it would be a good way to see what 
really happens throughout a program, to Increase 
generally the perceptions of everyone involved. 
Practitioners could use these strategies for internal revision by teaching them to both staff and stu- 
dents. The tools of anthropology, especially observing, are really what programs are trying to teach 
a lot of our students, at least at one level of experiential learning. The group would like more infor- 
mation on this type of measurement 
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The thinkers about evaluation found this a very 
exciting alternative. It seems the kinds of questions 
this approach answers are those that people ask when 
^ they are thinking about adopting a model program and 
that evaluators often have difficulty answering. How- 
aver, it will not get through JDRP, This seems to be 
the biggest single problem at the moment, although 
there does seem to be a trend in the direction of 
accepting these kinds of results. It is very hard to write 

a fundable design using such methods. Also, tfiere is a danger in jumping Into this too quickly be- 
cause at present, personnel with the skills to do it properly may not exist. 



The group had major problems along the moraNethical line. Often, clients who are trying to 
work on evaluation designs are told, do not ask the question unless you are willing to hear the 
answer. A potential exists here for finding things that should be recorded, but that might pose 
difficulties. For example, if a discrepancy between the organizational chart and the true lines of 
authority is reported, it is going to do some damage in the program, Thn group feels that before a 
study of this sort is done, some decisions would need to be made about what will be reported 
formally or informally. The group would like to learn more about this method. 



The group spent some time discussing the myths 
of our culture and various subcultures, among which 
is the myth that truth comes in numerical form with 
statistical treatment. Even so, some program staff 
and members of boards of education in fact make 
their decisions for the most part on the basis of 
anecdotal descriptive evidence, sometimes in spite of 
the existence of numerical data to the contrary. Also 
noted was a congruence between the kinds of ap-. 
proaches and data that you are describing in terms of anthropological methodology, and the source 
of programs in experiential education. The educational settings of experiential education programs 
are rich miniature cultures, and it is appropriate to use anthropological approaches to figure out 
what is going on. However, the resources required to gather these types of data are very substantial. 

The group tends to think of observation as a process tool, but there is no reason why it can= 
not be used to assess outcomes as well. That is to say, if one is describing very carefully what 
people are doing, over time data can be interpreted in the form of behavior changes that are taking 
place within a program. 
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Anthropological Peer Summation 



Thomai G. Carroll 
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Let me begin by building on what Sheila said. I find that I am in strong agreement with her 
emphasis on describing the structure of relationships between people and between them and their 
environment. In education we often call this the hidden curriculum and It is Important to anthro- 
pologists because its structure usually reflects the pattern of relationships in the wider culture, The 
structure of relationships and actions in any curriculum— hidden or overt-^ has a strong influence on 
the learning experience of the student. If we want to evaluate these programs we need to look at 
the structures they create and the patterns of action that the students display in them. 

I can expand on this by clarifying my own assumptions about experiential education. Kolb 
has provided a mode! of eKperiential learning which consists of movement through four phases in 
a repeating cycle. The individual moves from concrete experience to reflection on experience to the 
formation of concepts which organize that experience and then engages in a testing of those con- 
.cepts by a movement into new experiences. This is reviewed In Chickerlng's work on experiential 
education. This model Is attractive to anthropologists because It provides us with a concept of 
learners In active interaction with their environment. But this Is experiential learning and we are 
concerned with education. For a definition of education I use the term educe which is to draw out 
or to promote a process. I believe that in experiential education we are concerned with promoting 
the cycle of experfintial learning by creating a support structure for development of the learner's 
abili'ty to moK©-tRrough the phases of Kolb's cycle. This is In contrast to programs that rely almojt 
exclusiveHr'bn abstra^i^donceptualization-keeping students several steps rembved from practical 
experience where Jke concepts could be tested and where new knowledge and questions could be 
discovered by them. Experiential education is an alternative to educational programs that compart- 
mentalize the learning experience. It keeps the learning cycle whole. 

Now to talk about evaluating this process I must draw a diagram of the evaluation modt:l that 
seems to be most often used. It looks like this: 

T S - ? 

I call this an impact model because of its linear cause and effect assumptions. The teacher or edu- 
cational program is seen to be a causal force or prime mover impacting on the student who is con- 
sequently moved to some new pattern of behavior. This new pattern of behavior is representod by 
a question mark since it is the presence or absence of this changed condition in the individual that 
is to be determined or discovered by the evaluation. This is the basis of the common prG^post 
design. Anthropologists find this design quite unsatisfactory because it misses information on the 
reciprocal relationship between the teacher and student and between the student and the educa^ 
tional environment. It too often assumes that the effects of a program are limited to changes in the 
behavior of individuals and that these effects can be measured in isolation from the conieKts in 
which they occur. 
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As an alternative to that model I suggest an ethnographic evaluation model that looks like this. 



T - 



\ 



? 



\ 



Hare the focus of concern i^on the relationship between the teacher and the student and between 
the student and the setting. When we evaluate a program under this model we look for changes in 
the relationship between people and between them and their setting and we are less concerned 
with changis within m individbaL Yesterday it was suggested that there is always the possibility of 
looking for an effect that is noMhere. With these two models I would like to suggest that we could 
be simply looking in the wrong place. jThe pre-post design creates a search for effects on individuals 
that will appear In time as consequences of the program, the ethnographic model suggests that we 
win find effects in changed patterr^s of relationships as the program unfolds and that these new 
patterns of action can then be tracidilntc the future activities of the Individuals involved. Since the 
pre-post modnl of evaluation often influences program design it Is not uncommon to find pro- 
grams that have no mechanisms for changing relav. jnships between people. When anthropologists 
observe one of these projects they see that the pre-existing relationships of people to each other 
and to their environmem remHin Lmaffected and they repurt that the program has produced no 
changa or tha! it even supports the behavior it was intended to alten 

When vi^3 ta'/ about evaluation we should also be concerned with providing students and 
teachars with a means to evaluate their experiences as a basis for thyir continued development in 
the programs. I agree that students laarntng through experience-based education could use the skills 
of an anthropologist to move ihrough Kolb's phases of the experiential learning cycle. These stu- 
dents should learn to observe carefully and to reflectively organize their experiences for future 
action. 

As ^ example cf what I've been saying I would citu a program in my local area. In some 
schools students wrio have had shadow work experiences come. back to classes with information 
that contradicts wh^t they have been taught in class. At first this crsates a conflict because the 
teacher is no longer the exclusive ownei of the aducational process. Through the cyule of experi- 
ential learning the s :uden -s have tecome active participants :n their education and tney are able 
to formulaTe and t^st concepts on thp baci? of their own experience. They have the guidance of 
teachers and staff in doing this. Teacher:' can not be expected to give up their total control of the 
process of education without something in return. If ws work wlch them what they gain is a new 
working relationship with students and the potential for new work sites for educators where they 
cDuld work as liaisons batvyeen schowitf and community settings and even take on training posi- 
tiuns in local agencits and Industries. What the student? are gaining is the ability to reflectively 
^r.rlyze their practical experience and the reciprocal ibil'ty to test abstract concepts against further 
expnriences. They dernonstrate this while they ^re in th& program through the new relationships 
the / establish with the teachers/ and this p^oc'iss could traced into the relationships they later 
e'nablish as they enter the world of work. The point Is that Informaton about changed relation- 
ships in the program can be used to evaluate Its effectiveness, and that we can not limit ou^ atten^ 
tion to student outcomes. Teachers also change through their participation in these programs and 
we must monitor that process as well. The effect of a program is just not the one way unldimen- 
sional flow of outcomes that the pre-post design would have it be. To caputre the complexity and 
richness of the changes in these programs we need a more holistic ethnographic design. 
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Having made these comments I would like to respond to some questions and issues raised by 
the feedback session. 

The problem of discrepancy analysis posed by ethnographic evaluation is an important one. 
It is true that ethnographic evaluation can sometimes sound like a critique and be perceived as a 
threat by those responsible for a program. But it is too easy to say that we just have to decide 
whether we want to know these things and if we do we have to face up to the fact that we might 
not like what we find out. I think we have to look again at the models of evaluations we have. The 
same qualities that make ethnographic description valuable for program replication make it useful 
as a method of formative evaluation. Perhaps there should be more use made of formative evalua- 
tion and goal free evaluation. When I speak of goal free evaluation I mean a constant process of 
monitoring program development and making evaluative decisions as we proceed. We have a general 
objective but we assume that we will have trouble reaching it and that we will have to make correc- 
tions along the way. As long as the pre-post model continues to domlriate evaluation designs, ethno= 
graphic description will continue to produce discrepant information. I think there are three reaons 
for this. The first is that the pre-post design I described earlier tends to assume that program objec- 
tives are to change psychological or personal attributes of individuals. Because ethnographies focus 
our attention on the structure of social relationships between individuals and between them and 
their environment, they always provide us with information we had riot expected under the pre= 
sumption that program effects would only be psychological or individual in nature. I think the 
second reason we always have a discrepancy is the result of the tight pre-specification of outcomes 
imposed by the traditional evaluation model. We are dealing with a socially complex reality that is 
not easily controlled and efforts to change it in a highly specific way will usually fall short of the 
mark. We can see that as a defeat or we can use it as a learning opportunity. I believe we are always 
in a formative situation, I think it helps to look again at the four-cell matrix of evaluation outcomes 
that was put on the board (see Figure 4), 

Figure 4. Four-cell Matrix of Evaluation Outcomes 

r 

Stated unstated ■ 



intended 



unintencled 



If you look at the bottom right cell it is labeled as an unintended and unstated outcome. It could be 
a positive outcome but it is usually greeted with shock and it is seen as a threat or a negative out= 
come. But this happens in the framework of a highly pre specified goal. If we could recognize that 
we are always in a formative situation the information in that cell could become nev and useful 
information for future action. If wo could use this formative approach perhaps our evaluations 
would become part of a more dynamic experiential learning cycle for program development and 
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they would cease to be static records of program successes and failures. The third reason anthro^ 
pologists produce discrepancy analyses is that they are trained to do inductive research. In an evalu- 
ation they don't accept the project director's goals as a framework for their observations. On this 
point I believe that anthropologists entering the field of evaluation have an obligation to develop 
a clifeini urientation that would allow them to provide program directors with needed information 
without compromising the principles of ethnography. 

I would like to comment on the need for quantitative data and statistical analysis. We have 
many people in the field of measurement concerned with how we should measure things. Anthro- 
pologists do not deny the value of quantitative measurement but they tend to be more concerned 
with determining what we should measure. Perhaps we need a team approach that would relate 
the concern of how we measure to the concern for what we measure. This also relates to the issue 
of data triangulation, Triangulation is not limited to the need for data from the several different 
perspectives of individuals involved in the event. It also calls for the use of several different data 
collection methods in combination. We feel that research or evaluation that relies on a single data 
collection technique— be it observation, interview, questionnaire or whatever— is weak in relation to 
work that uses those methods in combination to provide information on the event from several 
perspectives that can be used to cross-check each other. A team approach might also be useful for 
this purpose. 

It is true that you can't always hire an anthropologist to do an evaluation for you. For this 
reason training in the observation techniques and methods of anthropologists is important and It 
is available. At the Project in Ethnography in Education at S,U,N.Y. at Buffalo we developed an 
inservice training program in ethnographic methods for school teachers, administrators, psycholo- 
gists and their staff. It has had extensive applications and it can be used with students to support 
their experiential learning activities. Direct observation is time consuming and we have provided 
ways to train people in the construction and use of focused observation instruments that fit their 
needs and that are less time consuming to use. 

The number of anthropologists doing evaluation is not great but they are organized and 
you can contact them through a subcommittee of the Council on Anthropology and Education : 

Committee 4: Ethnographic Approachs to Evaluation in EducatiDn 

Woodrow W. Clark, Jr, 
The Institute for Social Change 
2420 Bowditch Street 
University of California 
Berkeley, OA 94720 

Under the sponsorship of that committee we will hold a one day training workshop on ethnographic 
methods of evaluation at the American Anthroplogical Association meetings in Los Angeles this 
November, 

As for the criteria for evaluating ethnographies I would refer you to the summer of 1975 issue 
of Human Organization which is a special Issue on the ethnography of schools. It has a lead article 
by Harry Wolcott on criteria for an ethnography of schools and several articles in the issue deal with 
the problems of enthographic evaluation. 

Thank you. 
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SOCIOLOGICAL PERSPECTIVE 
ON IIMVESTIGATIIMG THE CONSEQUENCES 
OF EXPERIENTIAL EDUCATION 

Slipping Away: Social Control 
and Gxperirntial Education 



Frank J. Weed 
Charles E, Ramsey 
University of Texas, Arlington 



L Introduction 

This paper will present suggestions for evaluating experiential education programs that are 
different from the usual rules-of- thumb traditionally used in program evaluation. Some of the 
issues discussed in the paper can only be sketched out or briefly touched on; yet it is our intention 
to treat evaluation from a sociological perspective that will call for the consideration of variables 
often taken for granted in evaluating programs. 

First, we will set forth some of the assumptions that are a part of any sociological analysis, 
and that will underlie what we see as the possible range of effects of an experiential education 
program on the student and the school. Included In this task is an introduction to how the sociolo- 
gist sees the role of the school in society and specifically the experiential education program's 
role in the school. Because experiential education programs vary significantly from one another, 
we will attempt to summarize the critical elements of experiential education programs that are 
amenable to one form of evaluation. Finally an attempt will be made to suggest some evaluation 
research strategies that, with a good deal of further refinement, might be tried in attempting to 
evaluate experiential education programs. 

Program evaluation from a sociological perspective requires that we evaluate the social relation- 
ships that constitute the social environment of the individual participants. The sociologist attempts 
to understand individual motives, beliefs, and actions by attempting to locate the individual in a 
pattern of social relationships such that an individuars beliefs and behavior are understood to be the 
product of the social relationships. For example, a sociologist might explain a high school student's 
ambition to attend college by the social class position of his/her parents and the general social 
expectation of his/her peer group toward college. To the sociologist, when a high school student 
says he/she is very interested in attending college he/she is not simply stating his/her personal ambi- 
tion. The student is also expressing the social fact that he/she belongs to a group of individuals who 
understand and value these ambitions. The sociological interpretation attempts to make individual 
characteristics understandable by referring to their social context. 

When socral relationships form consistent patterns the sociologist refers to them as a social 
structure. The concept of structure in sociology is roughly the same as in other disciplines: a 
pattern of relationships between parts. To avoid difficulty with terminology we include values and 
beliefs as part of a structure, along with expected behaviors. Some of the familiar structures in 
sociology are the authority structures of bureaucracies orvthe patterns of social inequality in a 



57 



SLIPPING AWAY: SOCIAL CONTROL 
AND EXPERIENTIAL EDUCATION 



communitv that are analyzed as social classes* Two fundamental problems dealt with by the 
sociological perspective are (1) the relationship between a social structure and the individual, as the 
effects of the school structure on the student's occupational aspirations; and (2) the relationships 
between different structures, as in the relationship between high school and characteristics of the 
labor force in a community. 

The problems of evaluating a planned educational program for youth fall within the parameters 
of these fundamental problems, since the relationships we are to test in an evaluation study are the^ 
same as we generalize about in our theories of social structure. What a sociological perspective 
brings to a problem is a broad scope of analysis. Focusing Just on the students and their immediate ; 
contact with teachers, program coordinators, and employers restricts the analysis such that variables 
that deal with peer group, the student's family class position, the class structure of the school dis^ 
trict, the organizational characteristics of tfie school itself are presumed to have no effect, or the 
effects are presumed to be random when analyzing school programs. These variables have been 
shown to have a strong selective effect on the social liyes of individuals so they are likely to have an 
effect on experiential education as welL The fact that all of the variables sociologists like to use are 
not amenable to administrative manipulation should not deter us from using them for evaluation 
if they allow us to understand the functions of an educational program, 

Evaluating experiential education programs, in terms of a pattern of social relations, poses 
some difficulties. There are a number of obvious mistakes that evaluators can make if they are not 
carefuL 

One problem arises when the evaluator includes normative criteria in the evaluation process 
that do not pertain to the relationships that people participate in. Individuals do not participate in 
a whole social structure at one time so it is necessary to isolate relevant characteristics early in an 
investigation. For example, because a student spends a lot of time and energy in school does not 
mean that all aspects are relevant to him/her. It might be totally irrelevant to ask the student about the 
school budget or community tax levies. This does not mean that students are not affected by school 
budgets, because they are, but simply that it is not part of the social expectations that pertain to stu- 
dents to spend time worrying about school budgets, 

A second problem that often arises is when the researcher succumbs to a kind of normative ; 
determinism. Individuals' social experiences emerge out of their actions in these patterns of social 
relationships, and therefore, what is to be evaluated in any program are the characteristics and out- 
comes of these relationships. This does not mean, however, that individuals will do what they are 
told or conform to all the social expectations of the social relationships. Individuals may conform or 
they may deviate, but even in rebellion individuals tend to deviate in characteristic ways. It is neces- 
sary to realize that an individual can participate in a set of social relationships without being com- 
mitted to them. Students, for example, are not necessarily interested in education because they go 
to schooL They might care less about learning and yet be "A*' students. The error of normative 
determinism is to assume that individuals are committed to doing what they are supposed to do just 
because they are supposed to do it. Participation does not always imply commitment, 

A third related prohiem in evaluating educational programs deals with the role played by the 
stated program objectives in understanding a program. Social relationships are often surrounded 
by elaborate justifications, rationalization, and myths. These justifications make up the stated goals 
of a program but they are not designed to describe what goes on in the relationships between indi- 
viduals. They are normative justifications that are worthy of study In their own right but should not 
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be expected to provide an explanation of the social relationships in a program. For the sociologist 
these stated goals n jresent a set of expectations that may be very misleading since their purpose 
is not to explain the behavior of people but to perpetuate it and to facilitate the acceptance of the 
relationship in the eyes of others. It should be noted that it takes at least two people to make a rela^ 
tionship yet the justification of that relationship may be more self^serving to one of the partners than 
to the other. Thus, the idea that teachers teach students is more flattering to the abilities of the 
teacher than to the ability of the students as learners. Consequently, the sociologist tends to avoid 
falling into the trap of taking stated goals at face value and looks to the pattern of relationships 
themselves and what the social expectations are in actual practice. It is necessary in any attempt at 
program evaluation to avoid succumbing to the notion that we should simply test the empirical 
adequacy of the stated goals. 

A sociological perspective toward evaluation of experiential education programs needs to cen- 
ter on the social characteristics of the school program, and its potential impact as a social experi^ 
ence on the student. This perspective might become clearer in the following discussion that deals 
with some aspects of schools in American society and the roles that are possibly played by experi- 
ential education programs. 



II. The School and the Social Status 
of Students 

The educational institution represented by the American school is a complex structure of rela^ 
tionships which operate to create a social boundary that separates the student from the rest of the 
social life of the community. The development of this status is historically marked by three social 
changes which need to be briefly discussed because of their consequences for experiential educa^ 
tion. The first change deals with the creating of the special (formal) status of youth in the society, * 
and the next two changes are more directly related to the development of schools in the com- 
munity. 

(1) The first historical change really deals with the issue of control of youth. The term control 
here refers to formal legal controls used by the community to channel youth into schools. The 
development of compulsory education laws, child labor laws, and the juvenile court system virtually 
prevents a twelve or sixteen year old from becoming an economically independent citizen. These 
control measures contribute to, and are at the same time symbols of, the unique status of youth in 
our culture. The central institutions in their lives are supposed to be the family and the school, and 
they are systematically excluded, sometimes formally excluded, from participation in the other 
areas of community life (Trow, 1973:45 61). 

One of the apparent consequences of this statLis assignment is that it creates a "youth sub- 
culture" that defines much of the adult world as irrelevant becaLise students are not expected to 
become involved in it, or are prevented from becoming involved in the adult world. Therefore, 
experiential education programs often have to combat this problem by finding ways around child 
labor laws, or to overcomn the problem of getting students interested in the adult world, or in find^ 
ing ways of getting the auult world interested in students. 

The creation of the status of youth as a separate and distinct position means that peer groups 
and schools shape and affect their lives, but it does not imply that adolescents have fundamentally 
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different values. Their value system tends to be pretty conventional with the major difference being 
in the iaiience or degree of emphasis given to certain values (Eve, 1976, 165). This finding reflects 
the fact that the status of youth goes beyond the formal controli and has become a self reinforcing 
phenomenon (Lerman, 1968:219-235). 

(2) The second change we would like to note was the growth in the size of schools as organiza= 
tions as vvell as the growth of school systems. This growth in size of the American public school 
tended to increase the trend toward bureacratization of the school as an organization. The charac= 
teristics of bureacracy can naturally fall into two groups. One group of characteristics defines rela- 
tions of members of the organization to each other, and the other defines the desired patterns of 
behavior in the organization. 

School as an organization reflects changes in the first group of bureacratic characteristics 
through the process of specialization (Thompson, 1969). One aspect of the specialization process 
deals with the specialization of roles yielding increased centralization of control in the hand of ad= 
ministers as well as the addition of endless support personnel, specialists, and "coordinators" to 
supplement the activities of teachers (Callahan, 1962). The administration of the organization 
increasingly relies on scheduling, rules, standard procedures, and endless record keeping on teach- 
ers and students alike. For students the phrases "It is going down on your record/* or "Don't spoil 
your record" are enough to strike terror in their hearts for fear that their entire life would be 
tainted by what was in these recorc 

The specialization process also w .utes a greater differentiation of functions so that courses 
were taught by specialists in that subject as well as the fact that schools have taken on more 
functions-i.e,, athletics, R,O.T,C., clubs, driver education, delinquency prevention, and experh 
en tial edunation programs of all kinds. The specialization process here is partly a product of in- 
creasing size jrid a demand for "business like" efficiency, and partly a result of the school being 
presSb'^Rd to take on more and more socialization functions (Katz, 1971). With this change the 
school j!3 an organization becomes less homogenous; while each program tends to push to estab- 
lish their own domain and to work out an accommodation with other programs (Meyer, 1975). 

Finally, the relations between members have been altered by the schools changing their quali- 
fications for careers in the system. Specialized educational training replaced the old normal school 
educations as a necessary requisite for entering the system. Once in the system an individuars 
function has become increasingly specified by the specialized curriculum. Any function that did 
not require special qualifications (like coordinator of an experiential education program) could be 
left to the remaining staff whose area of specialization did not provide thiHri with a full work load 
assignment. 

The second g'^oup of characteristics of bureacratization refers to the elements that define 
desired patterns of behavior in the organization. Generally, bureaucratic organizations, school being 
no exception, tend to stress objectivity, precision and consistency in performing tasks, compliance 
and cooperation, etc. The normative expectations that surround student life in the school are repre^ 
sented by the very words that are used to describe "proper" behavior. Officials in the school are 
quick to state that "courtesy," "honesty," "dependability/' "a desire for success," "friendliness," 
"loyalty," "neatness," "punctuality," and "self=control" are the characteristics of "a good stu= 
dent," The fact that these normative expectations are constantly preached to the students implies 
that the school system doef not automatically assume that the students have these virtues, (In fact. 
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one wonders if the school does not automatically assume that the students are rude, dishonest, 
irresponsible, lazy, hostile, and sloppy by nature.) The American school has always been concerned 
with teaching "proper conduct" along with the academic subjects, and is one of the social insti- 
tutions in America held responsible for the moral training of young people. Schools have been sub- 
ject to criticism if they did not exercise a fairly high degree of surveillance and control over stu^ 
dents, and this pattern can raise difficulties for experiential education programs because it opens 
them to criticisms of not providing sufficient supervision. These paternalistic norms set the school 
as an organization apart from other bureaucratic types of organizations in the society (Havighurst 
and Neugarten, 1967:191^214), 

(3) A third historical change that greatly influenced education and the functioning of schools 
is professionalism (Katz, 1971 :36-37), The professionalism of education represents a movement to 
limit the influence of partMits or other ''outsiders'' in controlling the mode, manner, or content of 
school instruction. The running of the school was to be left to the professional who could deter- 
mine what was proper for the child to learn and when and how the child would learn it. The move- 
ment toward greater professionalism in American society never resulted in the educator gaining 
exclusive control over the child's instruction, but it did greatly increase their control and effectively 
limit the role of parents or elected school boards in influencing school policies. Today, in spite of 
the fact that the school is supposed to be under the influence of local control, and therefore should 
manifest any local differences, the professionalism has produced an amazing commonality in the 
operation of schools from coast to coast. 

These three elements, legal controls on youth, bureaucratization, and professionalism, are 
three of the more important elements in creating a social boundary around the school such that 
people in the school system talk about the larger community as being the ''real world." The school 
is not the "real world/' it is a "hybrid society" formed out of the process of creating the unique 
status of student. 

When we see the school, whethc >i Is elementary, high school, or college,- as a controlled world 
with its own patterns of authority, its own distinct grouping, its own ceremonies and rituals, and its 
own peculiar language, then we might imagine that the social boundary might become completely 
closed to outside influence. Yet the school seems to be very sensitive to the major social differences 
in a community like class or minority group status. Originally the school was to have an uplifting 
role in improving the moral training and literacy of the working class, but later the schools began 
to tailor their curriculums to the "need of the children" (Katz, 1971). In the interest of providing 
an education to everyone special tracks were developed for the middle class college bound, and the 
working class factory bound child, and this selection process was appropriately disguised by the use 
of "objective" testing. As the role of education as a necessary qualification for jobs has increased, 
the schoo! has changed from a class sensitive institution to a class creating institution in that it now 
plays a nidior fule in creating social inequality In America. 

Minority groups have faired even worse than simple social classes in that they have been made 
to feel unwelcome under any circumstances. The school dropout rates for blacks, Mexican- 
Americans, and American Indians testify to the fact that the school has failed to consider the 
"needs" of these children (Friedenberg, 1968). Only when delinquency rates begin to threaten the 
rn icjdie class segment of the community are the schools challenged to do "somettiifiy" to keep 
minority group adolescents in school (Moynihan, 1969:63 66), 
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Schools are not only sensitive to the social class and minority group characteristics of ttioir 
communities, but they are vulnerable to sociahpolitical fads. Regardless of whettier it is the "chal 
lenge of Sputnik/' "back to basics/' "mainstreaming/' or the need for "relevance" schools have 
always been challenged by certain types of social-political demands. Some of the programs that arc 
tacked on to the curriculum are responses to these demands. Driver education, drug education, 
vocational education, or experiential education programs arise out of the specific community pres= 
sure to ''do something/' anything, to solve a problem. Such programs represent the cultural senti= 
ments that the school should be able to do almost anything with youth. Yet, at the same time, the 
programs lack traditionally grounded legitimacy and are easily threatened by opposing factions, or 
are replaced by new social concerns. 

Finally, no discussion of the American schools would be complete without a few words atjout 
how students learn to behave in these organizations. First, it is clear from numerous surveys of stu^ 
dents that they by and large like school, and also like some of their teachers. Even school dropouts 
will speak of school in somewhat favorable terms especially because they miss seeing their friends. 
Getting an education, or a diploma, is often interpreted in power and prestige terms as giving a per^ 
son some standing in the larger community. This is particularly true of lower class blacks' view of 
education (Miller, 1968: 188), Yet it would be wrong to assume that because students have some 
positive attitudes toward school in general that they necessarily accept all its teachings. After all, 
teachers and administrators are representatives of the adult community. 

When students go to school they learn to get along in school by conforming enough so as to be 
relatively inconspicuous. This requires that the student comply with the regimentation of the school 
by being generally punctuaL Getting along in school also means being concerned with the school's 
external symbols of self. By this we mean being concerned with grades, test scores, evaluations, and 
one's "record" as reflecting on who the person really is, i,e,, their self image. This is a kind of self 
rationalization characteristically found in bureaucratic career patterns. Schools go to great lengths 
to try and convince students and/or their parents that these symbols are important and worth 
striving to maximize. 

The social economic background of students is associated with different interpretations of 
the achievement symbols of the school system. Upper-middle class students tend to associate suc^ 
cess With individualized characteristics of the person like intelligence, hard work, a desire for suc^ 
cess. Within this group achievement will vary somewhat with measures of self^concept. Success in 
the achievement system of the school is associated with positive self-image, and difficulty with the 
achievement system produces self-effacement. This pattern is not universally true, however, because 
self-concept and achievement are not related for black students but only for white students. What is 
related to achievement for many lower class minority students is their sense of control over their on 
vironment. If an individual is confident that his/her social environment will allow him/her to shape the 
future through planning and hard work then he/she will tend to achieve in school, but if he/she feels 
that success or failure are the result of external circumstances that produce "good luck" or "bad 
luck" then achievement is poorer; How achievement ^.ystems are perceived greatly influences whether 
an individual wiil work to maximize achievement in the system, and how an individual will rationalize 
his/her failure if he 'she is not successful in the system (Parelius and Parelius, 1978:304=306). 

Finally, the system requires that tfin student attempt to please or satisfy the teacher. The stu = 
dent quickly learns that there are three ways to do this. One is by fcnking, another by cheating, and 
a third by actually achievinq. By faking \hu student wishes to appear that he/she knows the right answer 
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or had the right intentions but for some reason performed badly. Cheating on the other hand is a 
more direct deception which implies that the student has learned to act in a highly opportunistic 
fashion with little regard for the values of the system. FinaHy.^chieving implies doing the neces^ 
sary structured task in a way that will be acceptable to the teacher. What these responses have in 
common is that the situation is structured so that what is to be done, and how it is to be done, is 
already established in the lesson plan. The student is never in a position to create his/her own situation 
and achieve his/her own ends. Rather, the student i put'^in a position where he/she must choose to act 
sincerely, i.e., do what is expected, or insincerely, i.e., fake doing what is expected, or a little of both 
behaviors. For this reason the very bright student and the relatively dull student may, for different 
reasons, find the system very unrewarding or totally irrelevant to their lives (Lichter, 1962:2). 

The social boundary that emerges around the school and adolescent life is, nevertheless, a tem- 
porary social world for the individuaL Sooner or later the adolescent must face the status transition 
from the world of youth to the adult world of the community. This status transition may represent 
a crisis for the individual, in that the normative expectation and the pattern of adaptation developed 
as a student may not be appropriate in hij/her new situation. In addition, this social boundary, like 
all social boundaries, limits our knowledge of the ''real world" and tends to create unrealistic 
stereotype"* about rhe social life on the other side. 

Experiential education programs tend to deal with the problem of the status transition 
between the school and the so-called "real world." The school in this case is providing a buffer for 
the status transition of the individual by allowing the student to participate in activities outside the 
school. Keeping in mind this sociological sketch of the American school and the status of students 
just presented, it is now necessary to attempt to isolate some of the necessary ingredients for an 
experiential education program. 



Ill, A Typology for Experiential 
Education Programs 

Experiential education programs consist of such a large array of activities that it is difficult to 
imagine that they could all have similar effects. For example, some programs require fulUtime 
participation, while others only part-time; some involv? rw;'c jobs and others volunteer work; and 
some require reports or research p ;.iers based on the c^^p^/ is-nce and others require virtually nothing 
more than attendance. The great variety of experiential eii. /ration programs makes the problem of 
evaluating them in any kind of systematic fashion difficult, it we are going to define these programs 
socioloqically as programs in which schools provide a buffer for the status transition of the student 
then we should be able id set down some minimal characteristics for the kind of programs that deal 
with that social phenomena. 

So as to k iep the sociological classification gef^eral enough to include a sizable number of pro= 
grams we wiT ' jke three variables and form a typofo^^y or characteristics of the program. The first 
variable will ine mdrnduaVs primary social identity. We are referring here to the institutional 
sector, educational or occupational, that the individual is socially identified with. When an indi^ 
vidual is a student and works at a job, he/she has both identities but one of them is usually primary 
in clefimmj the person's status \-^^ society, -It is this identity that is important in classifying experi^ 
cntiai fiducat in programs. 
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A second variable is the schoors relationship with the indlviduaL For the sake of simplicitv 
we will say that a school may have (1) an in-school instructional relationship to the student, or 
(2) an out of-school supervisory relationship to the student. The school program may relate to a stu- 
dent primarily in terms of classroom instruction, or in defining an individualized non-classroom 
program for the student. A student may participate in both ways combining classroom instruction 
with non-classroom experiences. Experiential education in this typology will be considered an out= 
ofschooi supervisory relationship. 

The third variable is participation in occupational experience or work activity. This variable 
refers to a person's activities in the 'Veal world ' or "adult world'' iind for our purposes can include 
volunteer work as well as paid work. The nature of this participation is important because, for 
example, a volunteer participates in a job but is t considered a 'Year' member of the organiza- 
tion, whereas an individual who is paid is considc: a member of the organization, which can pro- 
duce somewhat different social expectations and role conflicts. 

Putting these variables together four different kinds of educational experiences can be defined. 
The first kind in Figure 5 is the "normal'' student whose primary identity is that of student, who is 
involved in regular classroom instruction, and who may or may not work or do volunteer work 
after school or on weekends. The identity of ''normal" student also includes strong peer group 
participation as well as the larger community identifying the individual as a student. 



Figure 5, Typology of Educational Programs 



A. '^normal" student 

B. experiential education 
programs 

C. returning student or adult 
education programs 

D. leave of absence or stop out 
programs 



1 

Primary 
Identity: 
Student 



School Relationship 
a b 
Instructional Supervisory 
in-school out Qf-schooi 



Participation in 
occupational 
experience or 
work activity 




The second type in Figure 5 is what is called an expjriential education program rehuionship 
and includes some additional dements. First, the indiviuual is primarily idefitifioH ,u h student, wlio 
may, depending on the kind of program, be involved in some classroom insr^uction, fitit will 
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definitely be involved In a supervisory out-of-school relationship with the schooK This relationship 
may vary from one of highly structured activities and surveillance, to one of virtually no structure 
and very low surveillance. Nevertheless, the school is extending its relationship to the student 
beyond the usual limits set by time and space. Finally, the student is tu participate in some kind of 
experience in the "real world," As mentioned above, this may be a paid Job or volunteer work or 
some kind of structured activity. What is important here is that the individual tends to maintain 
the identity of student, i.e., student-worker or student volunteer. In this way even if the individual 
is a paid employee he/she is a member of the sponsoring organization under the special status of 
student-employee. The status distinction may be acknowledge by his/her special work schedule or 
simply a nickname given to the student by other employees. 

A third type in Figure 5 consists of programs for the returning student. In this situation the indi= 
vidua! is not primarily identified as a student, but more likely identified in terms of some occupa- 
tional role. He/she is involved in some form of instruction which may be related to his/her occupation, 
but what makes this type different is that the individual is not seen as primarily a student. Adult 
education programs or CETA programs tend to have these characteristics. 

The final type presented in Figure 5 deals with programs that allow a leave of absence from 
school so that the person moves from the status of "normal student" to an occupational status and 
then back to the status of "normal student" again. There is no extended supen/isory relationship 
with the school but there is a status transition. The "stop-out" programs in private colleges and uni- 
versities are an example of this. 

This typology is not intended to classify all types of educationatprdgrams but to simply define 
sociologically experiential education programs. For our purposes here let us state that educational 
program types C and D are not experiential education programs. This does not mean that indi- 
viduals in these programs do not have educational experiences, nor that their experiences cannot be 
systematically evaluated. It means that the variables and research design for evaluating type B 
experiential education programs probably would not work in trying to evaluate a// programs. 

Notice that we must acknowledge that students, of all kinds, often have jobs or do volunteer 
work as well as go to school. Students in an experiential education program may experience roughly 
the same thing that "normal students" do by going to school and having a Job after school. In addi^ 
tion, experiential education programs can be very sensitive to socioeconomic characteristics of the 
students and the school district. In terms of these programs it needs to be noted that the "real 
world" for upper-middle class students in an Executive Internship program consists of different 
elements than the "real world" for working class students in an Occupational Work Experience 
program. The tendency is for programs to be oriented to the socioeconomic background of stu= 
dents, however, this means that the program may not offer the student experiences that are funda- 
mentally different from the experiences of students not in the program but who are from the same 
socioeconomic background. The impact of these programs might be greater if we switched the pro- 
gram and the kinds of students around. Imagine for a moment taking lower class students from the 
"worst high school" in town, getting them a new wardrobe, and allowing them to spend their time 
with lawyers, bank vice^p residents, or the city planner in an Executive Internship program. Con- 
versely, imagine upper-middle class students working in a box factory or warehouse in some un- 
skilled job. This kind of experiential learning program would be much easier to evaluate because 
the experiences in the program would be markedly different than the experiences of the student's 
peers. Furthermore, It would require the students to change their behavior pattern so as to accom* 
modate a social environment that is more unnatural to them. If this example seems impractical it 
only proves our point that these programs are strongly influenced by the socioeconomic character- 
istics of the students, and that makes evaluation more difficult. 
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At this point there are a number of loose ends which need to be tied together to form a clearer 
picture of the evaluation programs we forisee in experiential education programs. 

IV. A Compilation of Some Key Points 

of Evaluation " 

The description of the American school and its position in the community stresses a number 
of points that have ramifications for the form and function of experiential education. The following 
are some of the more relevant basic aspects of the structure of the school followed by some of the 
hypothesized effects for experiential education programs. 

Organizational Characteristics 

1. Schools, as organizations, become more complex through the processes of differentiation 
and specialization. Each part must develop its domain, and establish a degree of domain 
consensus (i.e., agreement among participants in the organization regarding the appro- 
priate role and scope of a program), and each part gains a status relative to the other parts 
in the organization, 

a. Experiential education programs represent one of these differentiated parts and 
must have some degree of domain consensus, and a specific status in th^ organiza- 
tion. Experiential education programs may be perceived, by administrators and 
teachers as a vital part of the schooTs programs, or as not worth the trouble. Their 
relative status will Influence their effectiveness. Students are likely to give a program 
no more value and importance than it has in the organizational structure of the 
school in general. If the program's status is low, the student Is less apt to be Influ- 
enced by it. Experiential education programs may be mutually understood In terms 
of program resources and goals, or may be badly misunderetood. A high degree of 
domain consensus will increase the schoors effectiveness in utilizing the program. 

2. Schools, as organizations, have routines, schedules, requirements, etc., expected of every 
"normal student.'' These aspects represent a system of organizational controls, as well as 

a set of standards which are used to judge the actions of others in terms of ''fairness,'' and 
propriety, 

a. As experiential education programs deviate from "normal" expectations in work 
requirements, grades, time schedules, general surveillance of students, they may 
create conflicts (or more submerged conflict in the form of accommodation). Or^ 
ganizat^onally, the conflicts may emerge when a student clearly deviates from 
expectations (e.g., is arrested smoking pot In the city park) and the program not 
the student is blamed for the deviance. Experiential education programs may find 
themselves held accountable for many things that other school programs are not 
bothered with because experiential education programs violate norms of dlstribU' 
tive justice, 

3. Schools, as organizations, are involved in evaluating and grouping students on a variety 
of criteria. The American schools are powerful organizatlnns of social selection. Skills in 
reading, mathematics, athletics, sex appeal, and a great variety of talents and interests, 



66 



SOCIOLOOICAL 
PERSPECTiVE 



divide programs and students into endless verlapping subgroups. Even the general strati- 
fication Into freshman, sophomore. Junior, senior groupings is not a complttely closed 
system in terms of social contacts and the diffusion of information. Each subgroup 
carries with it connotations about the members' abilities and/or characten The more 
inclusive a single category Is in a student's life, the more he/she is likely to be labeled as hav 
Ing those abilities and character traits. 

a. The extent to which an experiential education program isolates students from other 
activities should be directly related to the degree to which they are labeled. Ad- 
ministrative selection criteria, or informal ways the school uses the program to dif 
ferentiate students greatly affect the kinds of labels applied by teachers and other 
students. Students in experiential education programs are sometimes referred to as 
the ''dummy drop-outs/' "freakb," or "delinquents." The labeling process may 
greatly restrict recruitment of new students because being in a program Impries 
that you are not "normal", yet ironically the more alUendompassing a program Is the 
greater will be its potential impact on students who do brave the stigma. 

Student Peer Groups . - 

1. It is now well known that the student body of the high school is divided into cliques, 
gangs, and other informal groups, and that the network of relations between these groups 
form an adolescent society. A status structure among the students themselves is formed, 
and rejection from membership in one segment tends to generate a new segment of the 
peer group system. 

As a segregated structure, the student body develops its own subculture dramatically 
characterized by the fads In clothing, music, and automobiles. This culture appears not 
to be a counter culture as some have suggested, but rather more extreme positions on 
certain values. Empirical studies show that teachers and students are on the same side of 
a Likert scale composed of questions based on situational dilemmas and values, but the 
students answer with greater magnitude in the direction supporting the notion of a 
separate youth culture. Some suggest this difference is a degree of idealism permitted 
because of not having to realize values in the context of the "real world" and make the 
compromises necessary to survival. 

a. One consequence of involvement In experiential education could be to retain stu- 
dents who might otherwise drop out of school. However, there are conflicting 
variables at work, such as the negative prestige being assigned to students who are 
in "vocational education" programs, when It Is combined with the availability of 
ful^tlme work may act to pull students out of school. 

b. A second consideration is the selective factor operating in volunteering for experi- 
ential education. It could be that students who have been partly rejected by the 
adolescent society are the ones who volunteer for the programs. Should such an . 
event occur, it could be possible that the Involvement of the student in the adoles- 
cent society would make a difference in the findings with resoect to the effect of 
thR program on the student. 
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. If a studsni volunt{?irs for a program his/her status to the peer group is different than 
if heyshe is coirced. VoSuntearing impliei positive motivesrand a willingness to be 
idpntified with the program, but coercion implits none of these things. With coercion 
a person goes along because he/she must. Therefore, the kind of pressure (sometimes 
subtle) placed on a student to be in the program will influence the kind of impact 
the program has on the student. 

d. Effective participation in an experiential education program requires some peer 
group support If the "normal students" cannot serve as a supportive group, then 
students in the program must function as a peer group. If the program fails to create 
the social support for a student, then the student will likely gravitate back to the 
"normal students" as his/her peer group. 

2. Students develop their own set of attitudes about the school setting. Some of the routine 
and rules are basic to maintaining the student peer group and others are considered alien 
and unnecessary impositions. Students conform or break rules and routines in terms of 
their own standards of order, and the schooTs ability to enforce the rules. 

a. Participation in an experiential education program whose organization differs radi- 
cally from that experienced by the "normal students'' may violate the norms of 
distributive justice held by students and cau^ hostility or rejection of students in 
a program. 

Status Transition 

1 . Schools are pivotal points in creating and preserving the dependent status of youth in 
American society. The sopial boundary created is reinforced by the peer group, the 
school, and the community. High school or college, students are expected to abruptly 
leave the status of student and join the "real world" at graduation with "realistic" 
plans for "their future/' The status transition may be met with a sense of isolation, 
fears of inadequacy, and a desire to find a pat formula for managing the transition, e.g., 
marriage, going on in school, join the army, or work for your father. 

a. An experiential education program that deals with the status transition should 
expose students to experiences such that the salience of some values in their adoles- 
cent oriented value system changes ^.nd others become more moderate. 

b. An experience education program that deals with the status transition should expand 
a student's "sense of control" of his/her future environment relative to his/her pre- 
program level of self-confidence or positive self^lmage. This calls for statistically 
controlling for self-concept. 

c. An experiential education program that deals with the status transition should affect 
students such that they manifest fewer avoidance behaviors than students not in the 
program. Students who are well integrated into the high school situation with strong 
peer group ties should practice patterns of evasion in this transition. An index might 
be able to be constructed dealing with various patterns of evasion based on the 
assumption that students in a program designed to deal with the status transition 
should exhibit less evasive behavior or beliefs. Such patterns that refer to future 
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events like early marriage or responies from students "that they don't think about 
their future'' or ''that they are simply going to go on to college and will worry about 
what to major in when they get there" might be characteristic of the evasion 
behavior found among students that are well integrated into high school life and not 
in an experiential education program, 



V, Methodology 

In the following pages, we consider certain methodological implications for the sociological 
perspective on evaluation. The central focut is upon general problems of design although some con^ 
siderations are given to specifics where we feel a deviation from standard techniques might be desir^ 
able. 

The General Context Traditionally, evaluation research has implied the design of a field dx= 
periment. The logic is that the participants, resembling an experimental group, are like non- 
participants, the control group, before they experience the program, If the experimental and con- 
trol groups are well matched then any differences noted between the two groups after the program 
experience may be attributed to the experience of the program itself. This design is most consistent 
with the logic of empirical evaluation, and is probably conducted as rigorously by educational 
psychologists as by any group of social scientists. 

Our suggestions for iupplementing the field experiment with other designs comes not, then, 
from the logic or from the way such studies are conducted. Rather, some of the perspectives and 
variables we think may be Important in evaluationirom a sociological point of view do not yield 
readily to the before and after design for a variety of reasons that will become clearer. 

We should mention at this point that we are aware that there are several aspects of the evalua= 
tion context tha^will modify recommendations or make some recommendations less likely to be 
taken seriously. The most difficult problems seem political in that the current ''taxpayers' revolt" 
and constant public criticism of the school on issues of teaching basics, violence, drugs, etc, make 
the role of evaluation in decision making very problematic. Yet the increasing threat from retrench- 
ment and the increasing criticism of the schools increase the need for more thorough and compre- 
hensive evaluation strategy. No longer can we risk one approach conducted with all of its strengths 
and weakneises, and be satisfied that we have met our obligations. 

Since all of the methodologies used by the various disciplines concerned with human conduct 
have weaknesses, it has been suggested that several research methodologies be used to test the same 
point. This approach is called triangulation, We recommend this approach using whatever method- 
ologies or designs seem appropriate to each analytical problem. For example, a before and after , 
field experiment, in depth interviewing, the reports of peer groups, and unobtrusive measures noting 
how people behave may all be used to determine whether changes In belief, i.e., a ''sense of con = 
trol/' on the part of participants in the programs occur. Another example would be a panel study, 
an unstructured interview, and later behavior observation to determine occupational choices that ' 
may be affected by the experiential education program. 

Even though the context within which evaluation of the experiential education program will 
be accomplished is threatening, we would be remiss in our role as social scientists If we did not 
point out thn potential for gaining knowledge for future programs If the evaluators keep such a 
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purpose in mind in designing their research. We are speaking here of testing what it is about a pro- 
gram which works and does not work for desirabis consequences. Should such an approach have 
been taken a half a century ago in say, evaluating the platoon system in Gary, Indiana, we would 
know much more about designing and evaluating the present study. This program placed one third 
of the student body in industry, one third in the classroom, and one third doing ijects, Some edu- 
cators at the time, especially those critical of the traditional school setting, wfe.e quite compli= 
mentary of this program. But no data were presented to show what it was about the program that 
had any consequence whatever. A search of the literature revealed no discussion of why it was dis- 
continued. We would hope that future evaluations of the present program cannot be criticized in 
the same way. 

What we are speaking of here is the generalizability of the things being evaluated. Let us take 
the field experimental design as one example. If participants are compared to non-participants, the 
only generalization which could be made to future or other programs would be that the total 
process as it is found in the schools In the study either work or do not work or work in certain ways. 
Therefore, if an imaginative and creative educator develops a program for out-of-school work experi- 
ence, he or she can use the evaluation findings of this program only if the social, economic, and 
cultural conditions are the same and if the program is identiticat. 

If, on the other hand, several things go on in the program which can be evaluated which can 
be generalized to other programs, much in the same way that hypotheses are tested for building 
knowledge in theories, then some use may be made of this in future programs. What happens in the 
schools in the evaluation study can be modified according to which processes worked and which 
did not as that program is expanded to other schools. 

. Problems of Design. The purpose of this section is not to offer completed research designs but 
rather to give some indication of directions that may be taken on points of difficulty introduced 
by the sociological perspective. We will deal with these at two levels: those problems in which the 
tests would he made with the individual students as the unit of analysis, and" those in which the 
school or community would be the unit of analysis. Wherever possible, we will attempt to reduce 
the institutional level problem to the individual level simply because it is then easier to handle. We 
will discuss both general methodological problems and specific techniques together in each of the 
sections. 

fndivicJuaf Level Problems 

1. The care with which matching is done in experimental designs in evaluation research 
greatly increases the rigor in such research. However, eKperiential education programs are 
voluntary. The choice, therefore, between participating and not participating in the pro^ 
gram is based on some factor relevant to the very experience we are evaluating. Should 
randonnization be possible in assigning people to participation and non-participation, in a 
particular school, we would recommend that that school be used in an evaluation study. 
The voluntary nature of the program and the difficulty tliis introduces into inferences 
drawn f.om before and after studies probably cannot be overcome. For this reason, and 
for others, we recommend triangulation of other types of evidence to suppoi i cnnclusions 
concerning, say, changes in a student's orientations. For c .jmple, including sarnplus of 
parents, teachers, and work supervisors may be necessary lo demonstrate changes in, 
sny, robelliousness or self confifloncc. The use of interviews from nther than yOLith would 
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employ the concept of informant rather than respondent. Such informanti can probably 
observe behavior in extreme casas, but the report of a "changed belief or attitude" would 
be an imputation. We would not deny that such imputations leave much to be desired, 
but would contend that paper-and-pencil tests measures leave much to be desired also. 

2, What is meant by evaluation of an education program often concerns measuring some 
kind of change in the individual student's beliefs or attitudes. When we are measuring 
belief in basic cultural values, such as the work ethic or individualism, certain character- 
istics of how individuals internalize values should be taken into account. One of the most 
important of these is the idea of a hierarchy of values. The principle is that most people 
subscribe to all of the basic values of a culture. Therefore, a question which avoids the 
criticism of being double-barrelled-in other words, it is a simple sentence, will not reveal 
some important differences between respondents. 

Research has shown that values which may be contradictory can be believed in deeply ' 
by the same person. However, when other factors affecting behavior demand a choice 
between values, the hierarchy comes Into operation. In addition, the hierarchy changes 
from one situation to another. Thus, items reflecting the various value dimension being 
measured should be attached to a variety of situations: peer group, choosing a Job, 
being a good marriage partner, and the like. 

The source of values learning is somewhat more difficult to establish because the same 
value may be learned from different sources. Should peer group, teachers, or the family 
differ in their value orientation from the experiential e^lucation setting a difference in the 
source of value learning may reveal more than a change in values. Open-ended interviews 
may reveal differences otherwise hidden by other techniques. 

It has been mentioned in several contexts heretofore that the work experience introduces 
a new set of expectations to accept or at least entertain new beliefs (and interests, atti- 
tudes, and loyalties) different from those which come from the social life associated with 
the school experience only. It has also been mentioned that the members of the adoles-^ 
cenl society in high school do not disagree as to the direction of their subscription to 
American values but rather differ in the degree to which they subscribe. We would 
hypothesize three changes wrought by the status transition and exposure to the ''real 
world": (a) that some differences in the beliefs in basic values will be associatei with 
participation In the experiential education program, (b) that the source of values, whether 
or not they differ in content, will be different, presumably more diffuse, and (c) that 
tolerance for different value orientations (particularly those associated with the adult 
world) might be increased. 

To the extent that paper-and-pencil tests are used to explore possible changes in values, 
the hierarchy should be taken into account. A ranking method, where the person must 
choose between important values, may be a closer approximation to the "real world'' 
choice situation. We have previously considered the first hypothesis, the change in the 
content and strength of values In terms of the hierarchy of values. The third hypothesis, 
on tolerance of different values (decrease in ethnocentrism), deals with '"certainty" 
questions. After a ranking or Likert value cjuestion, the degree of ethnocentrism can be 
measured by an additional choice question: How certain are you of this? Answers can be 
designf d to indicate the degree of certainty. 
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However, teachers, parents, and co-workers can also give evidence on their perception of 
how well the participant or non^participant can tolerate disagreement, differing vlew= 
points, and the like. 

3. A considerable amount of criticism has been offered over the years on the validity of 

grades as reflections of knowledge gained, and more recently on the value of a high school 
diploma, especially in terms of literacy. Nevertheless, both grades and diploma are 
socially defined in such a way as to make a considerable difference in the career of an 
mdividuaL Thus, educational institutions and the economic institution have norms of 
recruitment in which both diploma and grades are considered Important Further, if we 
place the effect of experiential education on grades and on the probability of completing 
high school in the sociological context, the effects noted feed into the internnstitutional 
relationship. This phenomenon would be important whether or not grades and diplomas 
represented real learning or not. Therefore, a student's grades, and his/her choice of 
elective subjects, might be a valuable index of the impact of an experiential education 
program on the student. 

Caution should be taken in using administrative outcomes as a measure of the program's 
effectiveness for the ^ idividuaL Many organizational situations are subject to serious 
cancelling effects. Let us turn to the matter of school dropoucs tor an illustration. 

For some students, the experiential education program may provide sufficient diversion, 
motivation, or interest to remain in school, even though all of their social indicators ' 
point to a propensity to drop out. For others Job opportunities may arise through con- 
tacts or impressions made at the place of work supplied through the program. As a result, 
the need to remain in school for employment reasons would no longer have any effect. 
The two conditions would cancel each other. To look only for net effects would result 
in the conclusion that the program has little effect on school dropouts. The importance 
of identifying such cancelling effects, if indeed they do occur, is in finding conditions 
which may be introduced which increase the Besired effect and decrease the undesirable 
effect. ' ' 

4. There is considerable amount of evidence that Job dissatisfaction Is widespread in the 
United States. Since jobs fill in about half the waking hours of the individual's day, 
this is a rather serious problem. Dissatisfaction in Jobs can be of two kinds: dissatlsfac' 
tion with the work setting or dissatisfaction with a career choice. We would suggest that 
one place to look for the impact of an experiential education program would be in terms 
of career choice and also find out if the students, through the experience in the program, 
eliminated jobs they had previously aspired to. This elimination process requires that a 
person have a clearer idea of what he/she wants from a career. The time to collect these 
data IS two or three years after graduation and get retrospective accounts of their prepara^ 
tion for the "real world" and their ability to make satisfactory choices in a job. 

OrgnnUational Level Pmblonm In a sense, evaluation which employs the individual participant 
as the unit of analysis is designed to evaluate the individual studonts, not the program. The fact that 
we so often measure some charflcteristic of the student when we are trying to judge the effective^ 
ness of n program indicates that we assume a causal connection between how programs are struc' 
tured ond the capacity of students to learn (i.e., measurabin chanqes in attitudes or behavior) As 
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luis i)ointo(i nut in a previous section, the mem fsresence of the youth in school docfs not imply 
lntirnifi(j from ihu schoors curriculum nithouyfi tliQ atjsencc of youth can ho taken ns tfio absence 
of scficjol iiMrmrui. Tfiis purs[)octivci can luuci us to look nt "what mifjhi fiave boon." Does ifio school 
fMvl d Wtiy to pkice youtii who are [)resent but not learning into ex()oriGntial oclucntion? 

From an oi/jani/titional point of viuw, wu iriay be just as interestcci in liow tlic? procjram fits 
iFito the siruciurt* of the scfiool as in how;.wfill the intencleci effects are found amoncj inciivicluni 
srudunts. Takinn this point of viE»w for a fTioment, wo can say tliat the specialization process in 
orfjHnl^anons shcniUl contribute to the realisation of an Indlvkhial's values and asf)(rat(ons. fn this 
sonue a "(jood" uxfieriential education prociram would be one that served all the students who 
wantofi ihis kind of experience. If all the students that wanted n fjarticular experience were not In 
the [)rD(|ram, ifien tfiu qLiestion wouki be; why not? 

Profiram cdfectiveness coufd refer to how well integrated the f)rocjram is in tlie structure of the 
schook a:ul because we are assumincj tfiat an individuars values and asf^irations are l}oinc] realized we 
would expect to see no real change in them. Therefore, a highly effective program would \m ex 
p{?cti?d to yield no fundamental changes in tfie inclivickial stiident. 

How a school uses an cyiieriential education program is critical to its effectiveness no matter 
how effectiveness is [kdinecl. A scfiool may iise the program as an enrichment program for inter- 
ested students, or use it to tr\ and koefi students from dropfiiny out of scfiook or tfie school may 
use tfie prociram iis a "tiumping grouncr' for recalcitrant stuflents. The traditional metfiods of evakh 
titifui etkicational programs, l)y evnluating tfie student, would not reveal the function of the program 
111 lilt? school. 

We htive ahfMidy Hugtjested Iwo variafik?s tfiat we feel woulcj f)e significant in evaluatinc| tliese 
f)rot|rams at an ortjani/ational lc?vek Tlu? first variable deals with the idea of doniain consensus which 
refers to tlu' relative consensus of the role and function of tfie [program among organizational mem 
iMMS. When teacfu?rs' and administrators' n^Sfjonses are compared witfi eacfi ottier and with the [)ro= 
gram coorclinatorH' res[)onses an orgnnization score is createtk The second variable refers to the 
fekitivt? status of the prcigram when compared to otiier functions in the scfiooL Tfie iirogram's status 
could l)e measured [)y eiihcM students' or teacfiers' responses to items thai ask for a rank orclering of 
[)r(){|riims on varinus dimensitins. 

riiesr two Viiriai)les might tfUMi be compared to various df^fiendent variaf)les likn student df* 
maiul for a prograni. oi the? pcMceningf? of sludfMitH who lt*ave tlui program ancj return to recjulnr 
dandies This anjIyHis calh; for usiiKj organizatioiu;, i.e., schnols, as llui unit of analysis and tlierefcjie, 
a Ham[)le of sclinols keefiing in fiiinfl community characiei isiics wouki fn? used to form tlie riata 
hasj' lor rhn <iMalvsis, F^efor{^ f)luiHim(i into such a stiidy it wrnild be usf'ful to df) a f(?w casf* studies 
first 

[fie cane study is a n uH hotlology wliich lias lost tlie hicjh repute h had a fialf century nrjo, 
cspiMaally wlien it is {:f)inbiiied witfi techriiciues of o|>en ended inteiviews, rliif>ct observation, nnd 
par ti(:i[)ani obser Viil ion . ffii'ie are Heveral fr-iiscjus why vvf^ feel l\w forfMjoing diiu.tissinn ol minluxl 
nlof|\ hsids us to leeornmiMid the case study appio.ieli. includint) tluisr^ less ri(jf)rous riatii gatli<'Mnf| 
techMKjues nn«fUiontM| I Mm nrain reason is (luif leany of [he variabh^s flo not lerul 1 iKMU^uTves to 
more figornus teel iiiir |U!'S. F irst, vai iiil)l<^s such as llie sncior)cnnom ic; status of tlu? family or com 
munity art' not ami>nal)U? to cfh; m** These types of varuifiles may mean that in soriu? communiiies 
and some scliools an eKperN?ntial education firogram would never lie aiuiccf^SH Secnnck variaf)kM; 
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such as the relationship between the school ancl the industry (cooperation, conflict, or no communi- 
cation) are too cumbersome to be compared to other communities even though they may be 
changed if great effort is exerted. The real unit of analysis here would be the community in which 
a given school and a given industry are relating in certain ways relevant to the program.: An ade- 
quate probability sample of such communities would be extremely burdensome and the variables 
difficult to measure. The use of the case study from a sociological perspective returns us to an older 
methodology, one which depends more upon the sensitivity of the researcher than on systematic 
data collection. Yet, it has proven in the past to be an effective way of redefining problems and key 
issues, and in this case it may be effective in redirecting research toward the organizational level of 
analysis. 



VI. Conclusions 

In this paper we have tried to make a variety of suggestions about (1) how the experiential 
education programs might be viewed from a sociological perspective, and some of the ramifications 
the approach implied; and (2) some possible ways programs might be evaluated. Yet we have 
stopped short of a specific research proposal or evaluation program in an attempt to keep our re^ 
marks general enough to deal with experiential education programs of all kinds. 

Evaluation must begin with a sociological analysis of the problem. The status of youth in 
American society, and the role of the school as an institution that is bureaucratic in form is a neces^ 
sary point in any analysis. We have argued that a number of historical changes in American society 
over the last half century or more have created a social boundary between youth (and their school) 
and the larger community. This social boundary creates a problem of a status transition for youth 
that represents more or less a crisis in their lives. 

Our comments have not centered on the various roles which students can choose to bridge the 
status transition except to comment that ''early marriage" or "joining tfie army" offer the student 
an answer to the question "What are you going to do?'' There is no doubt a number of aspects of 
"careor" choices or choices of fufure roles that are possible and maytae a study should center on this 
problem. Experiential education programs deal with this status transition by bridging the social 
bounclciry. Indeeci, experiential education may provide a vehicle (i,e,, a role) for dealing with the 
status transition that allows the student to learn about the real world before he/she must join it. 

We have tried to present a number of problems of organizational sf)ecialization in the school, 
and [iroblems of peer group structure which might cause difficulties for students in experiential 
eclucation programs. On the whole tliese points must be considered tentative hypotlieses at best. 
Without soverni case studies of high schools that specifically focus on these problems it is difficult 
to do more than rnnke a guess nhout what might happening. Nevertheless, wo fnel that along with 
evaluntmq tlie students, as inrlividuals, and £ittemf)ting to measure how they adapt to the status 
irnnsition hnvinfj been involved in an experiential ndiication program; we also feel it is critical to 
eVfijutite the progrtifn in tfie orgHni/ntionnl context tliu school itself, 
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iVALUATOR= 
CONCEPTUALIZER 



There are a number of trends in schools that are 
remarkably consistent, such as leparateness of pro= 
grams, degree to which program effectiveness depends 
on separateness, and how much identity students 
keep with their home schools. It was an interesting 
twist to look at the organ iiation as the unit of 
analysis rather than the student. 



Looking at these relationships seems important in order to identify early in the program the 
cost to various people involved. By being more aware of what it would cost, they can make better 
decisions on whether to participate. The program managers can comG up with equitable payments 
for that involvement that might reduce conflict. 



iVALUATOR— 
ACTION ORIENTED 



The group appreciated the emphasis on the 
institutinr; I context of experiential education pro- 
grams, even though it would not be an adequate 
focus for evaluation by itself. The group disagreed 
with what it took to be a suggestion for possible 
measurement: a sense of controL It seems to the 
group that the goal of experiential education should 
be to ^ive it a realistic sense of control, not neces^ 
\ sarlly greater control. That is, there are some adoles- 

cents wh6 ought to feel ihr?y havr less control over their environment than they in fact feel, and 
simply evbluating the proyram accorfjing to how high people's sense of control is would not get at 
that important factor. 



The question of avoiding status transition brings to mind Kenneth Keniston's suggestion 
that what is new and potentially good about youth today is precisely the opportunity it provides 
for young people to postponn tfioir assumption of adult responsibilities. That gives them oppor 
tunities to think and relate in ways that are not possible when adult responsibility must be taken 
on at the historically appropriate time. So perhaps a longer postponement of the status transition 
is beneficial. 
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l\m (|roup was a little overwhelmed by all the 

information unci confused regarding measurement of 
f)rnqrams versus measurement of individuals. The 

grouj) was not entirely comfortable looking at the EXPERIENTIAL 
f)rogram as separate from individual outcomes. It EDUCATOR — 

would rather look at the individual outcomes, ana in CONCEPTUALIZER 
addition look at the differences between them and 

the effects of the program as a whole, The group 

talked aLiout methods of recruitment to the proqr /ns 

and about the typical conflict in school systems oetween core curriculum versus experiential 

prnc;.^ams. 

The group would like to know more about the socialization of young people and the way in 
which the prociram lelates to that socialization. What other roles could be developed ^ ithin v 
context of the program, and to what extent is that different from roles studeiits can learn in tne 
scfiool system? 



American socio ty has created an adolescent 
stacje of life l)y lengthening schoQl years with 
leqal criteria. I f practitioners work for more experi- 
ential etiucation, then the degree of community 
5Uf3f)ort becomes a critical issue. As most are aware, 
(iroqrarns are movincj toward a point of business com 
muntty saturation. The group felt that tbis is more 
of an issue with vocational education programs and 
internshi[)S than with career educaviun and explora- 
tory programs. 

School seem to promote the idea that only teachers have the gift of being able to impart learn^ 
ing. The group feels Frank was suggesting that in order to [iiegrHie our experieniial eHucauan 
programs within the bureaucracy of tfie school system, we either have to break down the educa- 
tional waits or learn the structure and bow to work within it.. Keeping in mind what in important 
to th() t)rogram, what about the opinions of tedcliers? Are coniments like, *'at least tiiu teachers 
did not sabotage your fDrogram this year/' positive or does it mean they were so aparhetic they did 
not care^ Did they support the program, or did we just not bother them? The group thinks it is 
important to remember that we are functioning within an educational organization, and must decide 
where we are in tliat setting. 



EXPERIENTiAL 
K EDUCATOR- 
' ACTION ORIENTen 



; 77 ■ . ' 

er|c - 



SOCIOLOGICAL 
PERSPECTIVE 



Souiolofjical Peer Summation 

Rt)he>rt F. Sexton 
Univursity of Kentucky 

I want to comment for a moment on Frank's notions and then move to some yoneral thoughts 
tjrowinc) from all the presentations, Frank's paper is quite comprehensive and packed with insights. 
It is {lierefore im|)ortant that you read it carefully, concentratinc] especially on the evaluation issues, 
whicli lie skimmed over in his oral presentation. 

There is much similarity between his ideas and those of James Coleman in Youth: Transition 
to Acliilthnoci, some of Willard Wirtz's in The Bound/ess Resoi/rce, even some of the newer com = 
rnents on untlnrenif)loymeht, sucli as James 0 Toole's in Work, Learning and the American Futtjre. 
Frank is apfolying tne same kind of perspective to experiential education, and this is quite valuable. 
He reminds us forcefully of some points that appear in all our discussions, such as motivation, 
wliicli are cjuite important. He reminds us of the value of students personally setting goals and then 
stickintj to them, and working with other f)eople. Somebody writing about graduate political intern 
ships long ago quoted a graduate student to the effect that when ha was doing Ills internship in 
cjovernment, working together witfi other people was called good administration, but when lie wnnt 
Ijack to the campus it was called cheating. 

His focus on the i)0tential impact of these programs on social and economic class stratifica- ^ 
tions in the schools is also interesting; it's pertinent that at least two scholars here from outside the 
field of exfieriential education have mentioned this, one of the most critical things we can do: 
reversing the roles of our students in society. As an example, at many universities ! expect the stu 
dents who do field experience or internships are often those who need them least. They are the 
students who will succeed anyway, the students who can generalize from experience, the students 
wfiQ will leave the university and have no trouble getting jobs; they are the aggressive, bright and 
caf)ahlo students who are after their main chance and are putting together their life goals. But what 
about the remainintj less motivated and self assured students? If we focus solely on these students 
we face management f)roi)lefiis, but they are worth thfj challenge. 

'^rank also caulionefi us aboui a ''Uiheiing" issue, and the stigma often associated with these 
programs wfiere tfiey liavci a "vocat icinal" coimauitiorK Wliilu I would echo some of these concerns, 
ofie notion I sensed in all the papers and esfiecially Frank's was the tendency to see experiential 
(Klucation as something with content, like an academic discifiline. I want to share my bias that 
oxfiiMiential education is a process, a teciinic|uc it has no inherent content. It can facilitate certain 
instructional ot?|ectives, jList like seminars, filmsrrifjs, or simulations, luit inherently it is not an area 
of knowledge, Tfiis is not compatible to some of the conc(?()ts of ex[}erience based career education 
which are currently popular, but I don't tfiink th(; Office of Career EdLicotion has argLied that it 
has con tent . 

It's a very fiazy area. When Frank icleniifiod uxfVijrienMal ecjuCcition with driver education or 
drug education, he was leading us to a particular view of exfjeriential education The alternative 
would be to relate it to classroom objectives, or breadth of study, or to flevelnping skills in analysis 
or synthesis. His conception takes us toward the use of experience for only one type of learning, or 
a specific f program, rather than a compreliensive process for helping young [)eof)le learn oi a comf)re= 
hensive way of doing business around tfie school. 
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Now I want to uko the liberty of making some general comments which follow in part from 
Frank^s remarks and in part from others. The approach of using discipline^based scholars to consider 
experiential education is incredibly productive. To a degree they were all in something of a trap to 
start with; in u seme they were asked to be caricatures of their discipline. Under other circum= 
stances the scholariy paraphernalia and disciplinary justifications-' we psychologists do it this way" 
and "sociologists do it that way/' would not have been emphasized. We set them up a little bit to 
be criticized, but I expect they came here knowing this was their role and it was fruitful. 

These papers. Mken together and with some modifications, are a substantial contribution to 
the literature, partly because they are very thoughtful and not "how to do it," and partly because 
they are bastd on sound research and research orientations. Tm convinced that if we are going to 
integrate experiential fiducation s in instructional process we need not only disciplinary allies but 
disciplinary thought behind it. One next step would be for the psychologist to write a paper on how 
to teach psychology through experiential education. 

Employing some interpretativu license, we saw four models. One stressed career development, 
that paper could have moved just as easily into other forms of development as outcomes for stu= 
dents. The second was the economic model, which would measure payoff. The third stressed the 
total curriculum. And the fourth stressed "statun transition/' 

We might really make some progress if we combine these notions and add a few. All these out^ 
comes are important they are all outcomes inherent in our in'":MtutiOiis and they are oM outcomes 
that we should try to sort through. One thing that occurrer^ to le is that this discussion could have 
happened on almost any campus. In other words, if a school or college said "we are going to do ex= 
pe( inntial euucation and we are going to start planning and set up a committee" and these four 
people were on it, we would have the same kind a. discussion, Ws would then start sorting 
through ^^okay, which of those objectives do we emphasize." Then someone would have conv* 
hined them. And to do that we should consider a few other possibilities as models. 

One thing that struck me in all the presentations was the absence of interest in using experi^ 
ential education to teach basic, somewhat traditional, academic skills. Nobody talked about teach^ 
inq psychology or sociology or anthropology through experiential education. This could be dis^ 
ciplinary techniques, such as in field research, or it could be d^ veloping analyticnl dbility, under^ 
standing, and sensitivities. My contention is that for some students those things can best be t?uqht 
by confrontation with experience. 

The socond thing that should be thrown in the list of options is the ef %ct en community. 
While everybody was thinkiny about community impact, especially Nick, ^^^e r^ii'y Uidn^t deal with 
it directly or thoroughly. The question of "what is being contributed by students to the commu^ 
nity" and "what is the community getting" are critical. 

The third issue has to do with the whole concept of service. Where and how do w^i consider 
the place of "service" as part of our educational objectives? Is helping young people develop a sense 
of the importance of service in their lives as opposed to a "job" or family or religion one of our 
objectives? This is something that Dick Graham talked about both here and elsewhnre. We have 
focused more on work related, economics related, employment related concerns, and not so much 
on the idea that people need to have some sense of making a contribution. 
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FifKilly, ,1 fnurtfi issuu is cjuitfi inii)ortcjnt in the ioncj run. WtiLit happoni us we move toward 
:i,Hiifcition of nxistinc] coniniunity cigencios tincl tjLisinfissi^s witii youncj peaf)lo survincj internships? 
Ohviously we nujst consider cilternativQ tictivities for youncj fioof)ln, [probably by creating activities 
rfuU need dninrj [)Ljt linvo not been economically justifiable. Perhaps wo shouid help communities 
finil wtiys of (jrovitMnc) the services we know nre needed, hut for which there have not been 
rnsnurces, throucjh tfie involvement of lucJents. There are also discussions now of "national service" 
for younfj fieople as one ofitjon, and it's somethincj to think about seriously. This also raises issues 
rrHtJted to the nature of work, tfie way our economy operates, and issues Uiat have come up in con- 
versations about job shurinf], for example. With many new c^ntrants into employment someone may 
iicivf? to IfMive tfie labor force or not f!f?t In, or we are noincj to havt; to rearrange it. And this will have 
<in tdfnct on our ^itudunts as they leaffi in tfie community. 

So tfiesf' four fiotions the [)urely "academic" sicie, the community, empluisis on "service/' 
aufl tlie i^suf/ of liow this fits into the economy in cjeneral must fjn jclfied fn oLir hqt of concerns, 
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Tiio'iias R. Owens 
Nortfiwest RegionQl Educational Laboratory 

Ynsterday it was mentjoned that, after fivfi years, I cirn the sole surviving evaluator across the 
four rfKjjonal educational laboratories involved in the evaluation of Experience Based Career Education. 
I fjuess It's because Tm a slow learner. In some respects I feel like Don QuiKote chasing a dream-are 
there really learning outcomes out there resulting from experiential education or do we just imagine 
them? As you can probably judge from your two days' presence at this conference, it is frustrating 
to liave a gut level feeling about the impact of experiential education and be unable to adequately 
document these effects in a way that is convincing to others. 1 1 is reassuring to share this challenge 
with you. 

Over the past three or four years many of us have sensed a need to have a conference like this 
to exfilore some conceptual models to use in designing and evaluating experiential education pro^ 
grams. I think it is appropriate in the few minutes we have left to express tremendous appreciation 
ro Jerry Walker, Micluiel Crowe and Carol Beckman from the National Center for organizing the 
conference and to Ron Bucknam of the National Institute of Education for sponsoring this type 
of gathering. I also appreciate the willingness of the presenters to take a risk, to go beyond the 
safety of their acafiemic discipline, in sharing with us some of the insights that they think may be 
apf^liL^ble to this **beast" called experiential educat.on. 

As i recall the four separate prcr jtions of this conferencu, my thoughts are that thpre is no 
cy^n model, no one theory, that I ccic; pull off the shelf anci ^itq by itself. But taking Dick 
Graham's notions of stepping back as a philosopher and lookinn ai.thv values and nature of specific 
individual experionnal programs we might be working with, htliink we can identify things that we 
have learned from certain career development theories, for examfolo, t^uJ. may help us understand 
reinfionsfiips betwf^nn some of the short and >^ng term outcomes that we \. jv find. Your reactions 
yesterday to the four career development theories suggest that we hp r^uf^niip nf thoco models 
that tend to delimit our focus too sharply on only a few outcomes p.nd instead look at Uiose models 
that broaden our vision of outcomes that may he afiplical^le, 

Although this con teronce treated psycfiology, economics, sociology, and anthrofiology sepa 
rately, Ni-fiolas Kiefer indicated today ihat tlifHe n^^ in fact, people with anthropological back- 
grounds cofulucting economic stufiies. So nven as far as the four separate discifilines are concerned, 
there is a bridginc] effort. As preJCtitioners fk?v(}Io(iinfj or evaluating exfieriential learning proqrams 
we need to ha f;cle?ctic. 

In adfiition to tlie four disciplinf^:^ refIf?ctocl at this ccni ference there are Rfivf^ral other areas of 
inc|uiry that people are starting to look at for implications in nvaluatirifi ex()f>riontial learning pro 
grams. Two of these fields being explored are investigative journalism and law. Ffu exam[jle, Ecjon 
Cuba, a visiting scholar this summer with tlie Resnarcf ■ on Evaluation Project at i:he Nortfiwest 
Regional Educational Laboratory in Por tiand, Oregoti is using the metaphor of investifjative journal- 
'sm in exfDioring principles and methodologies that may be helpful in evaluating experiential learn- 
ncj and other typos of eciLicational firogranis. 
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Jerry Walker, in his opening remarks to this conference, expressed liis hope that we would 
move from being a collection of individuals present here to being a "yroup" in the sociological 
sense. It seems to me that through sharing ideas informally as well as in the presentaticns and reac= 
tions here, have taken the initial steps. What are some other ways of moving in this direction? 
First, we > i follow through on ideas that were sparked at th!s conference and maintain contact 
with those with whom we have found something in common. Second, we may wish to join certain 
organizations such as the Association for Experiential Learning, the Cooperative for the Advance^ 
ment of Experiential Learning, or the Society for Field Based Education. Third, with the increase 
in the number of people Interested in and doing research and evaluation related to experiential 
learning, the time may be right for forming a group on experiential education as a Special Interest 
Group of the American Educational ReRnarch Association. 

As I consider future directions in investigating the consequences of experiential learning a 
number of ideas come to mind. First, there is a need to continue exploring various conceptual 
frameworks that will help^us understand key components of experiential learning more thoroughly. 
Instead of looking at individual unique outcomes of separate experiential learning programs, we 
need to search for patterns that cut across various experiential learning programs. By looking at tlic 
relationships of program features and outcomes, we will become better able to suggest guidelines 
for developing new experiential learning programs and for conducting meaningful research, A 
second area of need is that of demonstrating, documenting and assessing some of the theories or 
combinations of theories that may fit experiential learning and then sharing this information. A 
third area of need that I think has been omitted the past two days is that of training teachers and 
staff for not only understanding hut also being effective in operating experiential programs or In 
applying experiential learn mg approaches in their instruction. These three needs, together with the 
of improved clarity of expected experiential learning outcomes and improved instrumentation and 
evaluation des.gns present a stimulating challenge as we face the future of ex i- ^-iu* ^vducation. 
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REFLECTION II 



Dan Conrad 
University of Minnesotci 



What follows is ijotli a personal and a group response to the papers and ideas presented at the 
conference. I would prefer to acclaim this a collective statement, but the processes of seiective 
ijttention md retention are too well known to f)errnit me to do other than follow tlie convention 
of ticceptinc) final responsibility for myself. 

The identity assigned Id and assumed by our group was that of the practicing evaluator 
actively enrjaged in assessing and evaluating experiential education programs. The questions we 
asked were of tlie Manday niornfng, to do variety, and the guidance sought was in the areas of 
xlesifin, instrumentation, analysis, and the like. If at times we strayed from that perspective it is 
only because no evaluator, even on Monday, should be divorced from the theoretical groundings 
of his/her method or of the educational practice(s) being evaluated. 

Reacting to the conference presentations from an activitist/practitioner [lerspective forces 
one mto the positiori .J the book re^'iswer criticizing an^ author for not .vriting n different book. 
The diffir .'fv for was that thU was the first such con ference and not the second. All of the 
presenters did a suf^ort) job of relating the gennral perspective of their discipline, the kinds of r|ues^ 
tions and issues raisefi hv it and, in a more gen :ral way, the methodology that characterizps .t. The 
latter was treated the niust summarily however, and since it was the chief concern of our ? o^ii, 
loft us hunnermg aftnr the n(?xt installment. 

In a sense, fiowever, tiie [iraut^i^^ng evaluator is always left waiting for the nex^ insta! :?nt, 
watting for somoono to add something specific to the overviews, adnjonitions, and framewoiksof 
annlyses. Tnbiiln R.ls^j is not a dead idea in the field of educational evaluation. Each conference, 
arncle, workshor) and hook presumes to be presenting the? first word on the subiect (not the last, of 
course) to an audience whose minds are devoid of information, free of ideas, and inn nient of 
thought. Like the firoverhial American history course tfiat runs, again and again, from 1492 to 1939, 
each sto[)s just short of the f^oint whr^re it's really gettin j inte: casting and where we err. apply v^/hat 
IS said to our own situation. 

"Goal sotting'^ can staruj as a case in point, ranking, ab it does, 'uci behind "arriving at a defini- 
lion" on both the tedium and inanity charts. To paraphrase an old idea, if all the words written 
on goal setting, and spoken in ( niuation workshops (a.m. of day om:. naturally) were laid end to 
end tlicy would stretch far intcj (jufnr space find we'd Idd a lot ijctter off and maybe even get 
son.jthing done. It will tarnish my nuudemic credentials to say this, of course, [)ut 1 do have a dream 
Lf an evaluation session that disfiefises suMimanly wirii tfie why. what, whi\ where from and what 
for, and fligs rights into thci how and with wfiat' 

I presumn I am now disciUcilified from a seconri conforence, f^ut can nonetheless suggosl n 
couple of ways to organize one. The idea of looking at tlio evaluation of exnerienfial oducation 
from tlie distinct perspectives of different disciplines is a worthy idea and should be retained. 
Furtliermore. the presenters at this conference were excellent so this part too nnuh' be kept the 
same. Only what we'd ask th.em to do need cliange. 
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We might offer e: h major speaker a choice of two assignmints. The first would be to look at 
H specific exparientidi program, or type of prograin, and then device a research or evaluation design 
to study it and/or its effects. From what they can see or be told about the program they would 
decide what processes or out:omes would most Interest them and use these as their focL Their pre^ 
sentations, then, could focus on the specifics of the design: what questions they'd ask, populations 
they'd study, exactly what instruriients or other data gathering methods the / would employ (with 
something on how they're used, why chosen, and a little on why some others were not cho . jn), 
whnt they'd do about pro[)!Gms of control and randomization, how they'd analyze the data, some- 
thing of their own discipline's history of work in that area, and the like. 

The second choice would be to present the representatives of the disciplines with a list of the 
core goals of experiential programs, the benefits claimed by their proponents, or hypotheses about 
what makes an experinntial program succeed. There is, after all, a substantial literature on eacl'^ of 
these things that mignt as well be used. Each presenter could, again, choose the issue or issues that 
would interest him/her and that are compatible with the concerns and methods of the discipline 
represented. T'le assiqnment, beyond this, would be the same as sketched above. We might, in addi- 
tion, providn implu time for a direct internhan^;^ or questions and ideas to pursue the ''nitty grin ; " 
and to help those of us who don't alwa\ jejt it'' the first time through. 

The interest in pursuiny such questions at another session arises from two sources. The first is 
the chronic gnawing in the back of every evalUtiior's mmd that certainly somebody has figured out 
how to do this job; that snrnebody has just the inbLrument or technique to capture those v^ariables 
which continue to eii: in ul The second souice is in the promise held out by the several real nuggets 
that ware found in all the major papers and in the group discussions. It's tempting to simply list 
them hfi but this paper is meant to focus on the specific concerns of practicing ovaluators - and to 
be hiiet. Reflections on purpose, blurring of effects, and credibility wil! be used to illustrate some 
of the things we found prcvocnHve. 

Richard Graham, at the outs'^^ t, placed the practice of experiential education and its attendant 
evaluative problems in a broad web of social influences and relationships. Any educational inter^ 
venrion is on! a very brief and circ. inscribed episode in the personal and social histories of stu- 
dents. However, th'^' same can b^ said of any of the series of "r;f!tical incidents" that help deter= 
mine who and what we are. The nim of any experiential proui arn is to be a benign critical incident 
far its participdnts, an episodo Qiving the individufi! some leverage against the indomitable pressure 
of external forcec and the erratic whims of luck and chance. THg real mission of educational evalu:i= 
tion i^ to expose th- workings of these forces, to aid educators in designing programs that "make a 
difference/' to establish what that difference is, and to help decipher which progrfiiiis md practices 
c.in rfjally produce tiiat difference. This is, to say the least, no mean task, ^hat it'^; ' .al, that It's 
worth do.ng, is what Graham impressed on us all, 

'n prob^ . ' lo' iS, there are two types of errors that researchers are warned ..j avoid, hut 
only one of * nese strikes fear in their hearts. That one is not finding differences that do exist. 
Differences can do i^lurred in many w.^y^ Amnng the chief offenders are time and other variables 
beyond the reabonable control of ^ny r^o^rsm. One strategy advised against the ravages of time is 
to focus attention on s/iort range goals -immediate and specific effects which other research has 
shown to have -n impact on major life outcomes. From what was said at\tlie conference, it appears 
we do have some knowicdge to guide us here. In the career area, for example, there are indicators 
such as exposure ro models, certain attitudes, and various behavioral skills that are reasonable 
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proHictors of cnreer siiccess, aru cichievaljle firocjrHm fjoals, fincl are amenable to short term investi- 
'jutivj? tfK:hfH(iLjf»s. The less (jiol^nl onti's analysis, oi '^^ur^o, thn rnoro clarity there must be nbout 
v.hcit It is the f)ro()rafn is workinc] toward, or, at leab; wiint the evaluator is trying to nieasure. Tluis 
thn noefl for (jonl setlinc) rnumcrcjos, ' 

A second causo of hkirring is that usually ihu evaluator is looking for morc^ than one effect, 
and fTiay make thn mistake of comt)ininfj data in such away that the differentiated changes in indt 
vicluals are canceled oLJt in the overall analysis. A recoursu liere is the strategy of focusing on indi- 
vidual chann^ scorns ari'^V in Dr. Osi| swords, to "aggrefiate in terms of the [larticular objectives 
tfiat the pro warn is nyifui to achieve." 

A third cause of blurnnfj is tfuit often tlie effects we are most interested in are also the most 
olustve (anfl. p rfiaps^ "abstrLisivu ). Furthermore, the measures most cre(;[|)le to outsiders, often 
including funding agencies, are f)a[3or and pencil standardized tests the least credible (most 
'ncreclible?) means of assessing them. A solution suggested by Dr. Kiefer is to pull one's head from 
tfie sand (or clouds) and face the ^^facis^^ the facts of what we really can claim to know, and how 
nuich It will cost (in terms of time, dollars, and '^^fort) to find it out. From this perspective fiis 
income criteria is nearly faultless, f^nrn than thai, the very iJon of a clear, easily measured educa- 
tional (loal IS slioGking! * " However , its aura of clarity seems to be achieved partly by down playing 
the impact of larger forces such as ti^ ie and social injustice, and [lartly by deemphasi/inc] that we 
really migfii need to know somethiri i uf tfiese elusive, ''expensive" variables. 

Drs. Weed and Walker shownd a greater willir ^ness to w:^de in /"muddle around in" was Dr. 
Wcill^^er's fihrasej murky vyaters. To do so requires son confidence in the utility of less precise 
mf/asurr^s and metiiofis, and some willingness to give credence to human judgment. It also demands 
that one admit the imprecision thus introduced, and that one be willing to confirm or refute the 
fif^H nijs of nuf: apfiroacli \)y luoking at eacfi issue from several [jerspectives and by different 
rnr'hnds. Tfie larrjofi word fn- tfiis is "iriannulation," a word and a stratoc|y that sfioLild be in every 
evdiudf or's rofjcrtoirf?. 

Tfiis ionsely !i jgests one O'Mer issue dL...ii;K.tKl ifi uur n;oup, one that may serve to i-ing this 
f)articuUir exercise to a close. The issue is credif^ility. As evaluarors we often ict as if the credibility 
of ^ researcii or evnliKjiinu study was so/niy a factor of its data anri the means used to collect it, 
But It's fTjo^e tlian tluit. A crndit)le study is cjne that's soundly based and one whose "story" is lioarc- 
ffierfiaf)^ wiifi interest) and deemefj rnasnnal)Ii^ {f?vfHi ccinvinriiKj) [)y some audience. Eacli of tfie 
disnif^linns reprnsefitnfj at fhp nnuff^rencf! n,m norab'r) [f^ar^'^s nf such crefiiliility. Galbrai^h in 
Economics, C, IVritjfu Milh^ if) Sociolrvjv, Frfjurl, even Skinuef. lu Psynholony^ Mead and Farh in 
Anrfirof)ninf|v are a few iliustrritiM is, Foi Otich of theGn [leonki, an imiioriant measurf^ of tfieir 
crtMjihility arises (arosfi) from the-r al)ihtv to cfffectively communicate their ideas. Of course, eckica 
rors can offer Jf)fin [)f'wr?v as a counter rxam[}lf:, but tfiat iTiay be [\w exccfitinn that firoves the 
rule Be thnf as ft may, f^iost evaluation sfuflif^s (anrj workshofrarifl conferena^ reports) are ai.ysmal 



'Throivn in to sliow I'm not a(|ainsf nnals. jUSt weary n\ (iiscussmf) them. 

' ' In spouse, our whole tirnuf) imfTiediately COfTductnd a ritual fla[)pinfj to rcjstore the murki 
ness of OLi r tat. 
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things to read. That we assign more credibility to tables nnd numbers than to narrntive accounts 
nmy say less about the scientific rigor of our discipline than about the quality ' our prose. Pcrhops 
effectiv" conimunication can be the subject of a third conference, tn the meantime, we've at least 
had exposure to some effective models in the persons of the presenters at this conference. For this 
wo thank them. 

There's an old saying that the purpose of at least certain kinds of public presentations ought 
to be to comfort the afflicted and afflict the comforted. The presenters at this conference did both, 
For those of us feeling smug in the preciseness of our measures and the clarity of our goals, there 
was the challengfi to be wary of blinders ihat block our vision of the unexpected and unintended, 
that Willie both programs and students from their social context, that find more ''significance'' 
in i J' burs than human judgment, that reveal something of a product but nothing of how it was 
ail,. ■ Mid or why. For those of us pride ful of our ouenmindednuS's and sensitivity to human 
mycu;ry and complexity there was an enuaily stronn challenge to dare draw some conclusions, to 
dare be precise about what it is we're loui:ing Tor and why we thinkg we might find it. In broadest 
ttrms this conference, from the practitionor's viewpoint, was a healthy mixture of reinforcement 
and (jrovocation. Clearly tfie book is not now closed on how best to assess the impact of experi^ 
entiai education (or even define what it isl). Like the practice we study, we must continue to 
"learn by doing." We cion't regret it. It's what makes iife interesting. 
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SYMPOSiUM ON ALTERNATIVE PERSrECnV^S 
ON IN' liSTIGATING THE CONSEQUENCES 
OF EXPERIENTIAL EDUCATION 



Thursday, June 22, 1978 



9.00 9:30 a,m/ Introduction 



9:30 10:10 a.m. Kuynote Address 

10:10 10:30 a.m= Overview of 

Presentations 



10:30 11:15 a.m. Psychological 

Perspective 

11:15 1 2.00 noon Small Group 

Interaction Sessio'^s 



Michael Crowe, National Ccmter fur Research 
in Vocational Education 

Jerry Walker, National Center for Research 
in Vocational Education 

Carol Bee km an. National Center for Research 
in Vocational Education 

Ron Bucknam, The National Institute of 
Education 

Richard Graham, Youthwork, Inc. 

Samuel Osipow, The Ohio State University 

Nicholas Kiefer, University of Chicago 

Sheila Walker, University of California, 
Berkeley 

Frank Weed, University of Texas, Arlington 
Samuel Osipow, The Ohio State University 

FACILITATORS. 

Tom Owens, Northwest Reqion:ji Educational 
Laboratory 

Don Conrad, University of Minnesota 

Richard Miguel, Nafi-: -h' Center for Research 
in Vocational Education 

Paul Schroeder, Nraional Cr'rir"r for Research 
in Voi:.ational Erjucatiof! 



12.00-1 .00 pjTi. Luncheon 

1 .00 1 :40 p.m. FGt?dback Session Participants 

*Coffee, tea available. 



1:40 2;00 p.m. 

2.00-2:45 p.m. 
2.4B 25 p.m." 

3:25-4:05 p.m. 
4:05 4;25 p.m. 

4:25-4 "I p.m. 

8:00=8:10 a.m.* 

8: 10-8.50 a.m. 

8:50-9.30 a.m. 

9:30 lOMOa.m. 
10:10 10;25a,m. 

10;25 11:05 a.m 

11:05 11:45 a.m, 

1 1.45 12.20 p.m. 
12:20 12:35 p.m. 

12:35 1:00 p.m. 
1 :00=2:00 p.m. 
2,00 4:00 p.m.* 

*Coffee, tea available 



Peer Summation 
and Focus to 
Psychological 
Perspectivo 

Economic Persi)tjctive 

Smtill G iup 

Inter ction Sessions 

F-oedtaack Session 

Peer Summation and 
Focus to Economic 
Perspective 



Recap 



Harold Hendurson, Appalachia Educational 
Laboratory 



Nicholas Keifer, University of Chicago 
Faciiitators and ()articipants 

Participants 

Robert Eckert, National Institute of Education 
Project Staff 



Friday, June 23, 1978 



Opening Comments 



Anthropological 
Pgrspective 

Small Group 
Interaction Sessions 

Feedback Session 

Peer Summation and 
Focus to Anthro= 
pological Perspective 

Sociological 

Pg! spective 

Small Group 
Interaction Sessions 

Feedback Sns^oon 

Peer Summation and 
Focus to Sociological 
Perspective 

Final Recap 

Lunch 

Free Discussion 



Jerry Walker, National Center for Research 
in Vocational Education 

Sheila Walker, University ?f California, 
Berkeley 

Facilitators and participants 



Participants 

Thomas Carroll. Clark University 

f i. Hfik Weed, University of i uxas, Arlington 
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BIOGRAPHICAL SKETCHES OF AUTHORS 



Rffh.i/fi A. Of nil in i 

Dr. GfYilitini n^auyuii his B.S. in Mf^ciiafTical E fifjinocrinc] in 1942 from Cornoll University, liis 
M.A. fn Arffiiinistrniion iru! \\\(]\\vr rflucation i;. '070 from Cnth.ilii: Univuisiiy, uiul l.is Ph,D. 
in Psynliolnciy in 1973 frofn AntioLh Collufjo. He is cnrrently Progrdm Aciministrntor at Youthwork, 
Inc. His f)rovioiis f)ro fossioricil positions inckjcie PrGsiclent of Gocldarci College; Exocutive Director, 
T!in Cmwr for Mnrn! DevclopnuHit anil Education, Harvard, Fudural Execolive Follow at the 
Rrookings Institution; D-rDctorof Education Programs tor ACTION . Director of the Teacher Cor[)s. 
U = S. Office of Education, Commissioner, Eciual Employment Of)portunity Commission; spveral 
Inadershif] positions with the Peace Corps; and several leadershir) positions in business ancl dustry 
He fjarticipares in numerous professional and civic activities. Publications include artmles c exfic^ i 
menfn learning community action, teacher education, voluntary service, school finc^pfie cusi 
ef fncnv*'ness'com()arison, inshtutinnal change, stopping out of school, mon ^^ducnnnn, ^-c : !i 
en^filoymen t. 



KitMf ( receiipd liis B.A. in 1972 from Florida State Urivnrs.ry, ^ncl iiis \'i.A. io i .^hjj 
frf^m Princoton I nivf?rsity in 1976. Hts flissf^rtntion is titled "Econonvuric Essays in l ; ' o^- ' c". crn 
k:s/' He IS cii-rnntly Assistant Professor of Economics and National Irst tute o^ Mi^nia' h^.^ahn 
f i rqfr^^crorai :=^^Mow at the University of Chirac]n. Prnviojsly he has t:Dn^ rtotrircn an:i ^ or:r) an In 
liiuntof ar Pr ncetnn. He has done man / [3u[3lis/i^id and unpublished pa::e^^ on such toiler as eco 
f\)mi.: henefifs ^rorn cjovernmcnt tranrifj urogr!: ns, Bay^sian analys:s dt iaoor supjJy and com 
fiiodity demaru!. vvacje offr^r distnluaiofis, efn;)irinal joi) searnii mofie , i fleets of post school mg 
voc J I :nna ' 'i lixdimn^ 



Dr. Qs:;)Ow rf^ceivfMl his B.A in 1954 fiom Lafayi'- ^' CcjIifMi?^ his M.A. from Columbia Umver 
siTy I'' 195n. anfl his PIkD. from SyraciiSe UnivfMSitv ^1 1959. He is currently Cfiairperson anri 
Prnf.-;.nr ^ rhn nnpa^tmnnf nf P^yrhni.-v|y j^u. Qhin Ptatn I J :i ^v-rni t y . Hin r^rnvious p f o ^issiona I 
pos.tions include heafl of tfie Counsnling Psycholofiy Area at Qhio State; psychologist rOd Assistant 
Pr()fessor . Penn StatP University; finrsoruie! [)S\'chr3lnf)!Sf in rhe U.S. Aiiry; many visitin(| a()f)Oin! 
iT^efits, cnnNtjitantships, and f )ro fnssiofial activifif^s af iinivfnsities, afj!Micies. research centers throuqh 
nut x\w country. He has \)v.m f^litor or reviewf^r \(n nuiny lournals, He is authoi or no author of six 
httoks on carfM'r dev^Hopment and cnnnselinn psycinMofiv, and of nvf?r 50 (ournal articlr^s on n wide 
fange ot f )Syr;lio!nfjica! and vocational ff)pics. Ih^ li.is nivpo ovfi 50 firf>sentcinofis anrj toclinical 
mnorts to a vanety of ron ferf?nces. He is a heensnfl psynhn'ofnst anrl an achve ninmher of tfi(^ 
AnuMican Psyntiolocjical Association. 
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ShmlaS. Walker 



Dr., Walker receivefl her B.A. in 1966 from Bryn Mawr College and her M.A. and Ph,D, in 
Anthropology from the University of Chicago in 1969 and 1976, respectively. She spent her junior 
year abroad engaged in African studies at the Sorbonne and the Institut d'Ltudes Polltiques in Paris. 
She is multilingusL She is currently Assistant Professor in the School of Education at the University 
of Ca'i .I'li, Bci kuloy. Previously bIio lias boim rusnarcli assist, r Jt the Marvarcl Divifiity School, 
frf?e-lance rranslator anci interpreter in the Ivory Coast, researcher for the Urban League and tt^e 
Mode' Cities Health Project in Chicago, lecturer at Elmiiurst Colloge and Nortinwostern University, 
escort-interpreter under contract with the U,S. Department of State. She has published a book 
mcj several articles, has reviewed books and articles, and has given many presentations. Subjects 
mclufje African religion, the Afro American experience, and Black women and education in 
America. S^te has mnnived several research fellowships and grants and belongs to several profes- 



Dr. Weed received his B,A. in 1965 from Hanover College, his IVI,A. from the University of 
Illinois in 1967, and his Ph,D. from the University of Missouri In 1974, He is currently Assistant 
Professor of Sociology at the University of Texas, Arlington. Previously he has been Assistant Pro^ 
fessor or Instructor at four colleges and has done extensive research In his areas of Interest which 
include formal organization, social change, social stratification, theory, and social welfare institu 
lioru. He has authored several journal articles, has presented a number of papers at sociological 
conventions, and belongs to several professional organizations, 

Cl E\ RnnisRy (did not attend Symposium) 

Dr. Ramsey received his B.S. In 1947 from Indiana State Teachers College, and his M.S, and 
Ph.D. from the University of Wisconsin In 1950 and 1952, respectively. He Is currently Chairman 
and Professor of the Department of Sociology at the University of Texas, Arlington, His previous 
professional positions Include Professor and Chairman at Colorado State University, teaching posi = 
tions at Minnesota, Wisconsin, and Cornell; a large number of research consultantships in agencies, 
government, and universities; membership on many committees of universities and government 
agencies. He has published many books and journal articles in areas of vouth and education, re- 
searcli methods, stratification and change, and demography and ecology. He is listed In Who's Who 
If) Anwrica. 
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